Commit Graph

Select branches

Hide Pull Requests

main

phase0-1

phase10

phase11

phase13

phase2

phase3

phase4

phase5

phase8

phase9

Mono Color

• 49c7653222 tools: add llama.cpp comparison baseline + standard benchmark suite Gahow Wang 2026-05-28 11:18:52 +08:00
• 9bb5c5c328 tools: add correctness + performance test scripts for Qwen3-8B Gahow Wang 2026-05-23 14:13:49 +08:00
• 986a289616 fix: 12 bug fixes from comprehensive review — 51 tok/s verified on RTX 5090 Gahow Wang 2026-05-23 14:13:43 +08:00
• a67e724119 docs: Phase 15 design doc + benchmark report Gahow Wang 2026-05-23 00:39:27 +08:00
• d5532ef209 phase 15: Tensor::empty + CUDA Graph infra — 50.3 tok/s (140% of HF, 45% roofline) Gahow Wang 2026-05-22 23:57:34 +08:00
• e207523e21 phase 15: custom GEMV kernel — 46.6 tok/s serial (3.5x improvement, 130% of HF) Gahow Wang 2026-05-22 22:22:31 +08:00
• 876d3f5d6a phase 15: batched decode forward — 35 tok/s (97% of HF transformers) Gahow Wang 2026-05-22 20:07:43 +08:00
• 9783fcf410 phase 15: decode attention kernel + fused silu_mul + fused add_rmsnorm Gahow Wang 2026-05-22 19:40:56 +08:00
• 6cc1c9332d docs: Phase 14 design doc + benchmark, fix Phase 11/12 honesty Gahow Wang 2026-05-22 18:51:29 +08:00
• d67dda404e phase 14: Flash Attention 2 for SM120 (RTX 5090) Gahow Wang 2026-05-22 18:27:39 +08:00
• ee68d3565d fix: comprehensive review + 14 bug fixes + Phase 12/14 overhaul Gahow Wang 2026-05-22 17:53:28 +08:00
• d8493bd70f phase 12: implement real continuous batching scheduler phase13 Gahow Wang 2026-05-22 13:44:26 +08:00
• 7d05ececa0 docs: split Phase 12 and Phase 13 into separate design documents Gahow Wang 2026-05-22 13:15:27 +08:00
• da043554ba phase 12+13: HTTP API server with OpenAI-compatible endpoint (Milestone ③) Gahow Wang 2026-05-22 12:55:19 +08:00
• 2be27d6d94 perf: GPU transpose/reshape/repeat_kv kernels (eliminate CPU round-trips) Gahow Wang 2026-05-22 12:01:07 +08:00
• 2d48f25e66 phase 11: GPU-resident KV cache phase11 Gahow Wang 2026-05-22 11:50:12 +08:00
• be5c64ea8a phase 10: GPU add/mul kernels + BF16 precision analysis phase10 Gahow Wang 2026-05-22 11:35:26 +08:00
• 268e40d764 phase 10: add Qwen3-8B benchmark + performance fix Gahow Wang 2026-05-22 10:25:33 +08:00
• 246ae1c590 phase 10: Qwen3-8B support (Milestone ②) Gahow Wang 2026-05-22 00:46:37 +08:00
• 64084d3489 phase 9: KV cache + autoregressive generation phase9 Gahow Wang 2026-05-21 23:39:41 +08:00
• cb12250ef0 phase 8: add benchmark framework + baseline results Gahow Wang 2026-05-21 23:29:41 +08:00
• e1e75fc7f6 phase 6+7+8: model loading, BPE tokenizer, GPT-2 inference (Milestone ①) phase8 Gahow Wang 2026-05-21 22:04:00 +08:00
• 6035ffdc0b phase 5: naive multi-head attention phase5 Gahow Wang 2026-05-21 21:17:23 +08:00
• c8e8153702 phase 4: transformer core kernels phase4 Gahow Wang 2026-05-21 21:07:24 +08:00
• 51a0f2eb14 docs: add design docs + takeaways for Phase 2 and Phase 3 Gahow Wang 2026-05-21 20:59:45 +08:00
• d77f921a12 phase 3: GEMM kernels (naive, tiled, cuBLAS) phase3 Gahow Wang 2026-05-21 19:48:05 +08:00
• a83971fa25 phase 2: tensor abstraction layer phase2 Gahow Wang 2026-05-21 19:45:22 +08:00
• c8f7bc0c3c phase 0+1: fix Rust 2024 edition compat + memory query phase0-1 Gahow Wang 2026-05-21 19:40:49 +08:00
• 9806b4db35 phase 0+1: project scaffold + xserv-cuda crate Gahow Wang 2026-05-21 18:40:22 +08:00