xtrain

Files

Gahow Wang a188c8a277 distributed: train_ddp_mp bin (process-per-GPU launcher/worker)

Dual-mode binary self-detecting via XTRAIN_RANK: launcher spawns one worker
per visible GPU forwarding full argv; worker rebuilds config from argv and runs
run_worker. CLI flags identical to train_ddp (thread-per-GPU, kept), so it
doubles as the before->after throughput driver. thread-per-GPU path untouched.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

2026-06-18 17:48:52 +08:00

xtrain-autodiff

gqa: real grouped-query attention (repeat_kv op + both SDPA paths + wiring + tests)

2026-06-18 01:37:37 +08:00

xtrain-cuda

gqa: real grouped-query attention (repeat_kv op + both SDPA paths + wiring + tests)

2026-06-18 01:37:37 +08:00

xtrain-distributed

distributed: train_ddp_mp bin (process-per-GPU launcher/worker)

2026-06-18 17:48:52 +08:00

xtrain-model

gqa: fix kv-proj shape test param indices (embed,attn_norm precede wq)