NVFP4
4 published articles
AI Infrastructure
The hidden tax every AI agent pays just got a target painted on it
Nvidia's Nemotron 3 Embed models attack the cost of agentic loops. The 1B variants, not the 8B flagship, are the real story for production deployments that count every token.
2026-07-16
Apple Silicon update
Ollama's Mac update just solved the three things that made local AI painful
Ollama's MLX engine update brings NVFP4 quantization for higher quality 4-bit models, 20% faster inference through fused Metal kernels, and a snapshot caching system that eliminates reprocessing of shared context in multi-agent, thinking-model, and branching scenarios.
2026-06-11
AI Infrastructure
Nvidia's 55-billion-token trick just rewrote the math on agentic AI costs
Nemotron 3 Ultra, Nvidia's sparse 550B model with 55B active parameters, promises to cut inference costs by up to 30% versus peer open models while keeping frontier reasoning. With a 1M-token context window and native NVFP4 quantization, it targets the cost of multi-step agentic workflows.
2026-06-04
Local AI Inference
Ollama rewrote its Apple engine. The M5 results are finally competitive.
Ollama previews MLX-backed inference on Apple silicon, pushing Qwen3.5-35B-A3B to 1,851 tok/s prefill on M5. The shift brings NVFP4 quantization for production parity and a smarter cache for agentic workflows.
2026-03-30