Gahow Wang

gahow pushed to main at gahow/xserv

2026-06-02 13:37:32 +00:00

34e9bee375 xserv-chat: render gpt-oss analysis as a Qwen3-style <think> block

gahow pushed to main at gahow/xserv

2026-06-02 10:11:49 +00:00

3b9e32e6cd kernels: fix uninitialized shared-memory read in M=1 decode GEMV

5157b2cd30 kernels: fix NaN in flash-attention sinks on fully-masked window tiles

ea5d8ba7ea xserv-chat: render gpt-oss multi-turn as canonical harmony (drop CoT)

c0a81c84e7 server: canonical harmony system message in gpt-oss fallback

3d6bb1918e xserv-chat: fix gpt-oss harmony chat (canonical system prompt + routing)

Compare 5 commits »

gahow pushed to main at gahow/xserv

2026-06-02 06:19:15 +00:00

f2e60218b4 xserv-chat: harmony channel routing + repetition penalty for gpt-oss

gahow pushed to main at gahow/xserv

2026-06-02 04:05:15 +00:00

3ee8df2c0f xserv-chat: filter harmony control tokens + stop at <|end|> for gpt-oss

gahow pushed to main at gahow/xserv

2026-06-01 16:58:18 +00:00

ae08896f46 xserv-chat: support gpt-oss-20b with TP; fix GEMV precision bug

gahow pushed to main at gahow/agentic-kvc

2026-06-01 01:35:44 +00:00

54e1f5266a MB5 PD ablation v2 results: concurrency axis + reuse 3-way writeup

3f997fda14 MB5 PD ablation v2 tooling: conc completion-panel plot + gpu_monitor dep

Compare 2 commits »

gahow pushed to main at gahow/agentic-kvc

2026-05-31 17:04:48 +00:00

19c443e3bc paper f2a: reuse-topology decomposition + mixture-sensitivity sweep

9c105cf05a MB5 PD ablation: controlled-variable reuse/conc redo + campaign tooling

Compare 2 commits »

gahow pushed to main at gahow/agentic-kvc

2026-05-31 16:55:45 +00:00

32f7f55990 v2: linear (default cache-aware) baseline + 2x wall-cap on first600s

gahow pushed to main at gahow/agentic-kvc

2026-05-31 12:15:16 +00:00

7529284cee v2: LMetric PD-colo vs PD-disagg on the real agentic trace

fafc44da79 MB5 PD reuse-centric ablation: tooling, data, Fig 1-3

a2111b6e18 PD-disagg docs: annotated corrections for e13391e contamination

Compare 3 commits »

gahow pushed to main at gahow/xserv

2026-05-31 05:23:37 +00:00

1d0ec32e8d server: Jinja chat template rendering via minijinja

4368e79695 model: fused GPU MoE kernel — eliminate CPU roundtrip

377a04b81f tokenizer: read pre-tokenizer regex from tokenizer.json

Compare 3 commits »

gahow pushed to main at gahow/xserv

2026-05-30 17:06:32 +00:00

241009a96c docs: remove TO-BE-FIXED.md — all listed issues have been resolved

gahow pushed to main at gahow/xserv

2026-05-30 16:56:57 +00:00

0c6135aea3 bench-gpt-oss: teacher-forced diagnostics + --prompt flag

ffd90ce7fb server: emit harmony developer instructions block for gpt-oss

3c9d5e260e server: harmony termination via is_eos + TP repetition penalty

99b212e6c1 model/sampling: NaN-safe argmax + optional repetition penalty

e11f15e009 tokenizer: support multiple end-of-generation tokens

Compare 6 commits »

gahow pushed to main at gahow/agentic-kvc

2026-05-30 13:10:31 +00:00

0b180c191e v2 exp(d): expand figure to 6 panels (TTFT/E2E mean+p90, TPS, per-worker GPU util)

gahow pushed to main at gahow/agentic-kvc

2026-05-30 13:03:14 +00:00

9b6091fe6e v2 exp(d): 5-policy routing under tracets vs thinktime — ranking flip

68f21bef23 bench harness: env-tunable vLLM health timeout + both-modes 5-policy driver

075f5bbc22 trace: time_to_parent_chat annotation + thinktime trace variants

Compare 3 commits »

gahow pushed to main at gahow/xserv

2026-05-30 08:36:13 +00:00

5cb3cf28f9 server: add gpt-oss chat template for proper prompt formatting

15c51f143e server: support GptOss in TP engine + benchmark script

d29c39d74e fix: GEMV NaN bug — skip custom kernel for small N (<256)

9ad91a4a92 phase19: MoE support — gpt-oss-20b end-to-end inference with TP=2

Compare 4 commits »

gahow pushed to main at gahow/agentic-kvc

2026-05-30 08:28:48 +00:00

8a6b22c11c Replayer think-time dispatch mode + benchmarking guidance

gahow pushed to main at gahow/agentic-kvc

2026-05-30 07:39:34 +00:00

f0d085ceda Merge remote-tracking branch 'origin/main'

8d422c4301 Migration trigger validation: unified_v4 fires at 2x QPS, not at 1x

Compare 2 commits »

gahow pushed to main at gahow/agentic-kvc

2026-05-30 05:34:24 +00:00

d9cf3126c6 docs: reframe PAPER_OUTLINE to GPU-hit-first + embed v2 figures

gahow pushed to main at gahow/xserv

2026-05-30 05:13:34 +00:00

46bfb59f30 Merge branch 'phase18-pipeline-parallelism': pipeline-parallel inference

11e0154e4d docs: Phase 18 pipeline parallelism — design + benchmark results

d5dcf1a5ab bench: PP harness (xserv --pp vs llama.cpp -sm layer)

824cc58daa server: pipeline-parallel HTTP engine (--pp N)

da3aaa134a model: pipeline-parallel Qwen3 (from_weights_pp + stage forward)

Compare 6 commits »

gahow deleted branch phase18-pipeline-parallelism from gahow/xserv

2026-05-30 05:13:21 +00:00