long-context
4 published articles
Artificial Intelligence
LFM2.5-Encoders make the small-model case: 3.7× faster than ModernBERT on CPU
Liquid AI's open-weight LFM2.5-Encoders make the case that production NLP belongs on small models. A 230M encoder beats ModernBERT-base on benchmarks and scans full documents in about 28 seconds on a laptop CPU, roughly 3.7× faster.
2026-08-05
AI Models
OpenAI shipped a long context fix. It just won't tell you how much better it got.
OpenAI shipped a long context fix without sharing any benchmarks. That silence might tell developers more than the update itself.
2026-07-28
Deep Tech
One routing pass to rule them all: 7x faster LLM decoding without the quality trade-off
CLSA uses one routing pass per sequence instead of one per layer, cutting KV-cache overhead while keeping token-level selectivity. Benchmarks show 17.1x throughput improvement at 128K context.
2026-07-26
Open-source AI research
Million-token context on a tenth of the KV cache: DeepSeek-V4's efficiency bet
DeepSeek's V4 preview pairs a 1.6T-parameter Pro model with a 284B Flash variant, both at one million tokens of context. The paper claims 27% of the inference FLOPs and 10% of the KV cache of V3.2, the numbers that make the context cost-effective to serve.
2026-06-22