overtraining
2 published articles
LLMs & Models3 min read
Open Source AI
Boris-2 feeds its 125M model 90B tokens, its 250M just 60B
Boris-2 pre-announces three small models with lopsided token budgets: the 125M gets 90B tokens, the 250M just 60B. Training runs from August 12 to September 10, with no benchmarks shared, only the stated ambition to reach SmolLM2-135M strength.
2026-08-16
LLMs & Models4 min read
Small-model race
BananaMind 2 Micro: 2.9M parameters, 75B tokens, and an extreme overtraining bet
BananaMind 2 Micro will pack 2.9M parameters and train on 75B tokens, roughly 25,900 tokens per parameter. Training starts August 3, release is estimated August 4 to 6, and a BananaMind 2 Pro public preview arrives the same day. No benchmarks have been shared.
2026-08-06