CPU inference
2 published articles
AI4 min read
Edge AI
Audio8's CPU-only runtime fits voice cloning in about 1 GiB of RAM
Audio8's ONNX runtime runs the 0.6B TTS preview entirely on CPU: INT4 autoregressive weights, a bundled 44.1 kHz codec, streaming PCM, and an OpenAI-compatible endpoint. The service takes about 1 GiB of RAM on a laptop, and no PyTorch or Transformers are needed at runtime.
2026-08-05
LLMs & Models5 min read
Artificial Intelligence
LFM2.5-Encoders make the small-model case: 3.7× faster than ModernBERT on CPU
Liquid AI's open-weight LFM2.5-Encoders make the case that production NLP belongs on small models. A 230M encoder beats ModernBERT-base on benchmarks and scans full documents in about 28 seconds on a laptop CPU, roughly 3.7× faster.
2026-08-05