Gahow Wang 579365f4a0 docs: run v5 — TinyStories saturation at dim768 (val 1.11) ...

设计文档 05-v5-tinystories-dim768.md（中文，xserv 风格）：数据 2.49B tok/5.33ep、
架构同 v4(净测数据变量)、bf16 8 卡 global 256、train 11.07→1.06 best val 1.1102。
核心发现「数据天花板」：v4(1.54ep)1.169→v5(5.33ep)1.110 仅 ↓5% 且末段 val 走平
⇒ TinyStories 在 dim768/127M-core 近饱和，v6 该换轴（更大模型/更广语料，非更多 TinyStories）。
xserv BF16 服务 3/3 prompt 逐 token 一致。

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

2026-06-16 17:56:25 +08:00

..

runs

docs: run v5 — TinyStories saturation at dim768 (val 1.11)

2026-06-16 17:56:25 +08:00

00-build-chain.md

docs: backfill T1 build-chain

2026-06-15 15:12:55 +08:00

01-tensor.md

docs: Phase T2 — tensor abstraction

2026-06-15 15:12:55 +08:00

02-gemm-autodiff.md

docs: Phase T3 — GEMM fwd/bwd + finite-diff

2026-06-15 15:27:03 +08:00

03-autograd-engine.md

docs: Phase T4 — autograd engine

2026-06-15 15:53:55 +08:00

04-tiny-transformer.md

docs: Phase T5 — tiny transformer

2026-06-15 16:09:30 +08:00

05-training-loop.md

docs: Phase T6 — training loop

2026-06-15 16:30:14 +08:00

06-performance.md

docs: Phase T7 — performance

2026-06-15 17:00:29 +08:00

07-distributed.md

docs: Phase T8 — distributed data parallel

2026-06-15 17:15:49 +08:00

08-export-xserv.md

docs: T9 verification results (xserv == xtrain, dash5)

2026-06-15 17:37:46 +08:00

09-batched-forward.md

docs: Phase T10 — batched forward

2026-06-16 00:44:50 +08:00

10-caching-allocator.md

perf: KI-5 FIXED — single-GPU 40K->93K tok/s, DDP scaling 1.3x->5x@8

2026-06-16 11:15:02 +08:00

11-bf16-mixed-precision.md

perf: KI-2 FIXED — dim768 bf16 fits batch 32, tok/s 31.5K→40.8K

2026-06-16 14:28:20 +08:00

known-issues.md

perf: KI-2 FIXED — dim768 bf16 fits batch 32, tok/s 31.5K→40.8K

2026-06-16 14:28:20 +08:00