Gahow Wang 15c51f143e server: support GptOss in TP engine + benchmark script ...

- tp_engine.rs: TpModel enum dispatches between Qwen3 and GptOss based on
  config.is_moe(). Server auto-detects model type on startup.
- tools/run_gpt_oss_bench.sh: one-click benchmark comparing xserv (TP=2)
  vs llama.cpp (BF16 GGUF) on GSM8K quality + speed

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-05-30 15:39:44 +08:00

..

src

server: support GptOss in TP engine + benchmark script

2026-05-30 15:39:44 +08:00

Cargo.toml

server: tensor-parallel HTTP engine (--tp N)

2026-05-29 11:10:33 +08:00