scaling laws
3 published articles
Artificial Intelligence
Musk's 'accurate' AI meme gets the past right and the present wrong
Musk reposted a meme splitting AI into a noble theoretical era and a brainlet scaling era. Both halves are real history, but the binary is collapsing: kernels returned as engineering, small models rival scale, and DeepMind is rebuilding rigor for deep learning.
2026-08-03
Open Source AI
Kimi K3 is the biggest open model ever. It's still not the best.
Kimi K3 is the largest open model at 2.8T parameters, but it fails to beat the best proprietary models on overall benchmarks. While it excels on specific coding and agentic tasks, the gap to frontier leaders like Claude Fable 5 and GPT 5.6 Sol exposes the limits of scaling without architectural and data breakthroughs.
2026-07-27
Artificial Intelligence
Microsoft's Phi-4 Model Redefines Efficiency in Breakthrough Research
Microsoft's Phi-4 model achieves state-of-the-art efficiency, matching larger models in reasoning tasks with significantly fewer parameters. Published on May 15, 2025, the research paper reexamines assumptions about scaling laws in AI.
2026-07-03