← All series
ESSAY SERIES
Qwenputer
3 essays. Start with the first piece or jump to the question you came for.
03essays
- 01
Qwenputer: a fully functioning, deterministic RISC-V CPU inside Qwen3.5
I compiled a RISC-V CPU into Qwen 3.5 4B's weights, using its Gated DeltaNet layers as RAM. It runs C and MicroPython inside the forward passes, and Qwen uses it for exact arithmetic.
9 min read ↗ - 02
Hybrid models can hide reasoning in their RNN state
Under answer-only training, OLMo-Hybrid learns to track state silently in its RNN layers and generalise past its training length. Capping Gated DeltaNet's write strength at 1, as Qwen 3.5 does, stops it.
9 min read ↗ - 03
Building oversight tools into a model's weights
A lie detector and log compiled into Qwen's weights that the model can't switch off, and an answer key planted inside a real Qwen 3.5 to test interpretability tools.
7 min read ↗