LLMs & Models4 min read
Systems optimization
DeepSeek just proved most AI inference speed tricks are working against each other
DeepSeek's DSpark paper reveals that naive speculative decoding degrades throughput under high concurrency. Its solution, confidence-scheduled verification, adapts block length per request and shifts the Pareto frontier of serving performance.
2026-07-12