ONNX Runtime
2 published articles
Hugging Face5 min read
Browser AI: WebGPU kernels and benchmarks
Hugging Face's 2.57x WebGPU speedup comes with 176 losses attached
Hugging Face published 207 Apache-2.0 WebGPU kernels, a loader to run them from JavaScript, and a browser benchmarking tool. Its headline 2.57x speedup over ONNX Runtime Web kept 809 of 1,756 test cases and records 176 losses.
2026-09-16
AI4 min read
Edge AI
Audio8's CPU-only runtime fits voice cloning in about 1 GiB of RAM
Audio8's ONNX runtime runs the 0.6B TTS preview entirely on CPU: INT4 autoregressive weights, a bundled 44.1 kHz codec, streaming PCM, and an OpenAI-compatible endpoint. The service takes about 1 GiB of RAM on a laptop, and no PyTorch or Transformers are needed at runtime.
2026-08-05