Labs & Research4 min read
AI research: arXiv paper, 3 September 2026
One training query covers 71.5% of what a full LLM distillation dataset does
A new arXiv paper finds that one training query reaches 71.5% of the state coverage a full distillation dataset does, and that 16 diverse queries match full-data training. The bottleneck, the paper argues, is how fast a student absorbs supervision.
2026-09-17