LLM inference
3 published articles
AIFeatured3 min read
Open Source Tools
30 GitHub repos that power the AI stack, from agents to local inference
A practical rundown of 30 essential GitHub repositories for AI developers, grouped by use case and ranked by community adoption.
2026-07-30
LLMs & Models4 min read
Systems optimization
DeepSeek just proved most AI inference speed tricks are working against each other
DeepSeek's DSpark paper reveals that naive speculative decoding degrades throughput under high concurrency. Its solution, confidence-scheduled verification, adapts block length per request and shifts the Pareto frontier of serving performance.
2026-07-12
DeepSeek2 min read
LLM Inference Optimization
Aleph Alpha builds a theoretical inference model to decode DeepSeek V3 performance from hardware primitives
Aleph Alpha's theoretical model predicts DeepSeek V3 inference performance from hardware parameters alone, revealing how GPU count and interconnect bandwidth shift the bottleneck between compute, memory, and communication.
2026-07-04