Labs & Research3 min read
AI Research
Memory Decoder: a 6.9B bolt-on memory makes a 410M model beat Pythia-12B
Memory Decoder at Scale splits long-term memory from reasoning in LLMs. A 6.9B pretrained memory lifted Pythia-410M past Pythia-12B on 17 benchmarks with 39% fewer parameters; 1.7B domain memories added 9+ points to Qwen3 Base at every scale tested.
2026-07-31