gahow/xtrain
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Compare commits

base: gahow:2e68942032dd677dfb87e2a6df04d92fe1af1e62
Branches Tags
gahow:main
..
compare: gahow:59e33f60e3967e8da00bd39606243fe426f47a42
Branches Tags
gahow:main

2 Commits
2e68942032 ... 59e33f60e3

Author SHA1 Message Date
Gahow Wang
59e33f60e3 docs: Phase T4 — autograd engine 
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
 2026-06-15 15:47:43 +08:00
Gahow Wang
f3a1188f0e ops: differentiable autograd nodes + per-op grad-check tests 
ops.rs wraps each Tensor op as a Var node with its backward closure (forward
caches captured by move). swiglu = mul(silu(gate), up); attention is composed
(matmul+scale+softmax+matmul), no fused kernel. tests/autograd.rs grad-checks
every op via the L=sum(W∘out) template, plus a fan-out grad-accumulation test
(dL/dx=4x) and an end-to-end composed-attention grad-check (dQ/dK/dV). Adds
xtrain-cuda dev-dep for device selection in tests.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
 2026-06-15 15:47:43 +08:00
1 changed files with 4 additions and 0 deletions
Expand all files Collapse all files

4
crates/xtrain-autodiff/Cargo.toml
View File

@@ -5,3 +5,7 @@ edition.workspace = true
[dependencies]
xtrain-tensor = { path = "../xtrain-tensor" }
[dev-dependencies]
# Acceptance tests need device selection (set_device) to drive the GPU.
xtrain-cuda = { path = "../xtrain-cuda" }