Gahow Wang

gahow pushed to main at gahow/agentic-kvc

2026-05-30 08:28:48 +00:00

8a6b22c11c Replayer think-time dispatch mode + benchmarking guidance

gahow pushed to main at gahow/agentic-kvc

2026-05-30 07:39:34 +00:00

f0d085ceda Merge remote-tracking branch 'origin/main'

8d422c4301 Migration trigger validation: unified_v4 fires at 2x QPS, not at 1x

Compare 2 commits »

gahow pushed to main at gahow/agentic-kvc

2026-05-30 05:34:24 +00:00

d9cf3126c6 docs: reframe PAPER_OUTLINE to GPU-hit-first + embed v2 figures

gahow pushed to main at gahow/xserv

2026-05-30 05:13:34 +00:00

46bfb59f30 Merge branch 'phase18-pipeline-parallelism': pipeline-parallel inference

11e0154e4d docs: Phase 18 pipeline parallelism — design + benchmark results

d5dcf1a5ab bench: PP harness (xserv --pp vs llama.cpp -sm layer)

824cc58daa server: pipeline-parallel HTTP engine (--pp N)

da3aaa134a model: pipeline-parallel Qwen3 (from_weights_pp + stage forward)

Compare 6 commits »

gahow deleted branch phase18-pipeline-parallelism from gahow/xserv

2026-05-30 05:13:21 +00:00

gahow pushed to main at gahow/xserv

2026-05-30 04:51:02 +00:00

9a01c60100 server: GPU argmax fast path for greedy decode

c679f618fd model: fuse QKV/gate_up projections, batched decode ops

cc4bd4cfe5 paged-kv: kernel-based scatter + fix data_ptr offset bug

13ae3de69e kernels: reshape_and_cache, GPU argmax, single-launch GEMV

6ce21345be cuda: add cached_trim() to release pooled GPU buffers

Compare 6 commits »

gahow pushed to main at gahow/agentic-kvc

2026-05-30 04:48:40 +00:00

dc8e6dd5a8 v2 exp(a): add remote KV-store (RDMA) tier

gahow pushed to main at gahow/agentic-kvc

2026-05-30 03:23:46 +00:00

ad754cfe0b v2 exp(b): GPU KV-capacity APC/latency knee + writeup

837df6bc9e v2 exp(a): three-tier KV-hit latency microbench (GPU >> CPU >> miss)

Compare 2 commits »

gahow pushed to phase18-pipeline-parallelism at gahow/xserv

2026-05-29 14:35:01 +00:00

b8868d59ac moe: FIX decode — route all gpt-oss matmuls through dense cuBLAS

gahow pushed to phase18-pipeline-parallelism at gahow/xserv

2026-05-29 14:29:57 +00:00

fcd7fa62b7 moe(wip): decode-path debugging tools — decode STILL broken

gahow pushed to phase18-pipeline-parallelism at gahow/xserv

2026-05-29 14:28:50 +00:00

6fdfb1b9d9 moe(wip): zero dequant output — decode STILL broken (not fixed)

gahow pushed to phase18-pipeline-parallelism at gahow/xserv

2026-05-29 14:24:59 +00:00

0b76207d21 moe: fix decode correctness — zero dequant output (was uninitialized-read)

gahow pushed to phase18-pipeline-parallelism at gahow/xserv

2026-05-29 14:21:38 +00:00

afe7cc6645 moe(wip): KV-cached gpt-oss decode — NOT yet correct

gahow pushed to phase18-pipeline-parallelism at gahow/xserv

2026-05-29 14:21:17 +00:00

603b6eb270 moe: correct + deterministic KV-cached gpt-oss decode (single card)

gahow pushed to phase18-pipeline-parallelism at gahow/xserv

2026-05-29 13:54:09 +00:00

7e7d077ff1 moe: KV-cached GPU decode for gpt-oss (O(1)/token)

gahow pushed to phase18-pipeline-parallelism at gahow/xserv

2026-05-29 13:51:02 +00:00

94957c5727 moe: MXFP4-resident experts on GPU (single-card gpt-oss)

gahow pushed to phase18-pipeline-parallelism at gahow/xserv

2026-05-29 13:43:00 +00:00

f59ba73938 docs: MoE progress snapshot before dash5 reboot

gahow pushed to phase18-pipeline-parallelism at gahow/xserv

2026-05-29 13:40:25 +00:00

58062bd326 kernels: fix MXFP4 build — wire quant module + mxfp4.cu (7ebdd7c didn't build)

gahow pushed to phase18-pipeline-parallelism at gahow/xserv

2026-05-29 13:38:56 +00:00

7ebdd7c552 kernels: MXFP4 -> BF16 dequant kernel (verified vs numpy)

gahow pushed to phase18-pipeline-parallelism at gahow/xserv

2026-05-29 13:31:05 +00:00

403879959a kernels: fix sink-decode build (b4db953 didn't compile)