Tried Tensor::zeros (instead of empty) for the dequant output on the theory
that decode read uninitialized memory. It did NOT fix it: decode top-1 still
diverges from the forward reference AND is still non-deterministic run-to-run
(top-1 varied across runs), generation still garbage. So the bug is NOT a
dequant-output init issue. Root cause remains OPEN. Forward (host attention)
remains correct ("Paris"); only the KV-cache decode path is wrong.
Do not trust decode output.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Gahow Wang
6fdfb1b9d9