LLMs & ModelsFeatured4 min read
Deep Learning
M3D and Real-Guidance Bring Dataset Distillation to High-Resolution Realms
Dataset distillation has long been stuck on low-res benchmarks, but a new approach called M3D changes that. By combining multi-scale matching, a data manifold prior, and a Real-guidance strategy, it scales to ImageNet-1K at 128×128 resolution, achieving 68.5% top-1 accuracy with just one image per class and cutting memory usage by ten times.
2026-07-05