LLM architecture
2 published articles
Labs & Research3 min read
AI Research
Memory Decoder: a 6.9B bolt-on memory makes a 410M model beat Pythia-12B
Memory Decoder at Scale splits long-term memory from reasoning in LLMs. A 6.9B pretrained memory lifted Pythia-410M past Pythia-12B on 17 benchmarks with 39% fewer parameters; 1.7B domain memories added 9+ points to Qwen3 Base at every scale tested.
2026-07-31
LLMs & Models2 min read
Tokenizer-Free Architecture
Aleph Alpha unveils T-Free: a tokenizer-free architecture for sovereign AI
Aleph Alpha unveils T-Free, a tokenizer-free LLM architecture that maps words directly to vectors. The approach delivers nearly seven characters per vector versus the typical four, cutting costs and energy use while improving performance on specialized domains and low-resource languages.
2026-07-03