MLX
4 published articles
Mobile AI
Gemma 4 goes fully offline on mobile, no cloud required
React Native developers can now embed Gemma 4 for offline inference with hardware acceleration on both Android and iOS. The model handles vision and tool-use tasks locally, as demonstrated by reading a flyer and scheduling a calendar event entirely on-device.
2026-07-09
Performance
Gemma 4 runs 90% faster in Ollama 0.31 with a trick that needs no config
Ollama 0.31 introduces multi-token prediction for Gemma 4 on Apple Silicon, achieving near 90% faster token generation on coding benchmarks. The speedup comes from an auto-tuned draft model and a custom MLX kernel that eliminates redundant weight reads.
2026-06-29
Apple Silicon update
Ollama's Mac update just solved the three things that made local AI painful
Ollama's MLX engine update brings NVFP4 quantization for higher quality 4-bit models, 20% faster inference through fused Metal kernels, and a snapshot caching system that eliminates reprocessing of shared context in multi-agent, thinking-model, and branching scenarios.
2026-06-11
Local AI Inference
Ollama rewrote its Apple engine. The M5 results are finally competitive.
Ollama previews MLX-backed inference on Apple silicon, pushing Qwen3.5-35B-A3B to 1,851 tok/s prefill on M5. The shift brings NVFP4 quantization for production parity and a smarter cache for agentic workflows.
2026-03-30