LLMs & Models3 min read
AI Research
Penelope hides its reasoning in a single decoder layer to cut inference costs
Penelope, a latent-reasoning framework for decoder-only Transformers, localizes recurrent computation to a narrow decoder interval, cutting inference latency without a major accuracy hit. The paper describes a curriculum that shifts reasoning from visible tokens to an internal GRU loop.
2026-08-04