xserv

Files

Gahow Wang 5cb3cf28f9 server: add gpt-oss chat template for proper prompt formatting

The gpt-oss model requires a specific prompt format with <|start|>,
<|message|>, <|end|>, <|channel|> tokens. Without this, the model
produces degenerate output. Auto-detected via config.model_type.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-05-30 15:43:29 +08:00

xserv-cuda

cuda: add cached_trim() to release pooled GPU buffers

2026-05-30 12:50:04 +08:00

xserv-distributed

distributed: NCCL P2P primitives (PpContext + send/recv)

2026-05-29 18:45:42 +08:00

xserv-kernels

fix: GEMV NaN bug — skip custom kernel for small N (<256)

2026-05-30 15:20:04 +08:00

xserv-model

fix: GEMV NaN bug — skip custom kernel for small N (<256)