Benchmarks & Tests
Comparisons, performance tests and model evaluations.
3 published articles
Agent evaluation
Sandbox benchmarks are hiding how agents really fail, HKU just built the fix
UniClawBench evaluates proactive agents across five fundamental capabilities in 400 bilingual real-world tasks, using live Docker containers and a three-agent closed-loop evaluation. It disentangles base model abilities from framework choices, revealing where agents truly break.
2026-07-13
Benchmarks & Tests
Treble Technologies and Hugging Face Launch FFASR Leaderboard for Far-Field Speech Recognition
The new FFASR Leaderboard from Treble Technologies and Hugging Face evaluates ASR models across nine conditions including reverberation, background noise, and microphone distance. Early submissions show far-field WER at low SNR is several times higher than near-field performance, highlighting the need for acoustically robust models.
2026-07-02
Performance
Gemma 4 runs 90% faster in Ollama 0.31 with a trick that needs no config
Ollama 0.31 introduces multi-token prediction for Gemma 4 on Apple Silicon, achieving near 90% faster token generation on coding benchmarks. The speedup comes from an auto-tuned draft model and a custom MLX kernel that eliminates redundant weight reads.
2026-06-29