xserv

Files

Gahow Wang fcd7fa62b7 moe(wip): decode-path debugging tools — decode STILL broken

Honest checkpoint. Builds green. The KV-cache decode path (decode_step/
generate) is NOT correct: top-1 diverges from the verified host-attention
forward and is non-deterministic run-to-run; generation is garbage. Two
attempted fixes are included but did NOT solve it: gemm::matmul_dense
(cuBLAS without the m==1 GEMV shortcut) and zeroing the dequant output.

What IS verified and correct (unchanged): the host-attention forward
(gptoss-logits forward path -> top-1 " Paris"), the MXFP4 GPU dequant
kernel (mxfp4-check == numpy), and the sink-attention kernel in isolation
(sink-attn-check == CPU ref, max_diff 0.0017). So the decode bug is in how
decode_step composes these (KV layout / per-step state), not in the kernels
themselves. Root cause still OPEN; see docs/MOE_PROGRESS.md.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

2026-05-29 22:29:55 +08:00

xserv-cuda

kernels/cuda: paged-attention kernel, dispatch, pinned host memory

2026-05-28 19:58:36 +08:00

xserv-distributed

distributed: NCCL P2P primitives (PpContext + send/recv)

2026-05-29 18:45:42 +08:00

xserv-kernels

moe(wip): zero dequant output — decode STILL broken (not fixed)

2026-05-29 22:28:45 +08:00

xserv-model

moe(wip): decode-path debugging tools — decode STILL broken