synthetic data
4 published articles
Sovereign AI · Germany's language models
Aleph Alpha needed 4 trillion German tokens. The open web offers 1.94.
Aleph Alpha's ablation work sets a 4-trillion-token floor for German pre-training. The six largest free German datasets total about 1.94 trillion, and roughly 600 billion of that is machine-translated English.
2026-09-17
Embodied AI
Xiaomi just gave every robotics lab a 38-billion-parameter data factory
With a 38-billion-parameter model that unifies four robot tasks and open-sources the entire pipeline, Xiaomi aims to break the data bottleneck in embodied AI. Early benchmarks show a 26% improvement in task completion rates when training on model-augmented data.
2026-07-15
Synthetic Data Strategy
Nvidia's data atlas shows why synthetic data matters more than model weights
Nvidia's Nemotron Post-Training v3 Prompt Atlas provides an interactive map of billions of synthetic data samples, highlighting how open synthetic data is the missing layer for building reliable AI agents. The company argues that agent behavior must be inspectable and that synthetic data, released openly, is the only way to preserve proprietary signals without exposing trade secrets.
2026-07-12
Synthetic Data
Synthetic data generation just ditched its weakest link: the boss
Matrix is a decentralized framework that uses serialized messages passed through distributed queues for multi-agent synthetic data generation. By eliminating the central orchestrator, it achieves 2 to 15 times higher throughput on identical hardware.
2026-06-06