model compression
2 published articles
LLMs & Models5 min read
On-premise factory AI, arXiv preprint
Compression cost a factory assistant 13.7% of its answer quality
A new preprint argues that once a model is compressed and adapted with retrieval, parameter count stops predicting the quality of answers a factory-floor assistant gives. Its one case study loses 13.7 percent of judged quality to extraction and recovers two thirds of that.
2026-09-25
LLMs & ModelsFeatured5 min read
LLMs & Models
Mistral's cascade recipe shrinks LLMs without killing reasoning
Mistral's cascade distillation shrinks large models into small ones while preserving reasoning and vision. The 3B variant packs capabilities that used to require ten times the parameters, and it's all Apache 2.0.
2026-07-17