Gahow Wang c87a0bc44e docs: known-issues / perf backlog — KI-1 DDP weak scaling at small global batch ...

Surfaced by v2 (world=4, global_batch=32): ~3593 tok/s, no speedup vs v1
single-GPU. Root cause + proposed fixes recorded; also consolidates deferred
T7 items (bf16, activation recompute) and the large-vocab modeling note.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

2026-06-15 19:56:58 +08:00

..

runs

docs: run v1 — TinyStories full, dim256

2026-06-15 19:09:46 +08:00

00-build-chain.md

docs: backfill T1 build-chain

2026-06-15 15:12:55 +08:00

01-tensor.md

docs: Phase T2 — tensor abstraction

2026-06-15 15:12:55 +08:00

02-gemm-autodiff.md

docs: Phase T3 — GEMM fwd/bwd + finite-diff

2026-06-15 15:27:03 +08:00

03-autograd-engine.md

docs: Phase T4 — autograd engine

2026-06-15 15:53:55 +08:00

04-tiny-transformer.md

docs: Phase T5 — tiny transformer

2026-06-15 16:09:30 +08:00

05-training-loop.md

docs: Phase T6 — training loop

2026-06-15 16:30:14 +08:00

06-performance.md

docs: Phase T7 — performance

2026-06-15 17:00:29 +08:00

07-distributed.md

docs: Phase T8 — distributed data parallel

2026-06-15 17:15:49 +08:00

08-export-xserv.md

docs: T9 verification results (xserv == xtrain, dash5)

2026-06-15 17:37:46 +08:00

known-issues.md

docs: known-issues / perf backlog — KI-1 DDP weak scaling at small global batch

2026-06-15 19:56:58 +08:00