vLLM
4 published articles
DeepSeek-V4.1-Flash lands on Cambricon's vLLM stack
A 552B model, a quarter of the HBM, and a day-one Cambricon port
DeepSeek-V4.1-Flash reached Cambricon accelerators on day one through vLLM. The port says less about the model than about how fast Chinese chip vendors can now follow a public inference framework.
2026-09-22
Qwen / Alibaba
Qwen3.8-27B can read 1M tokens, but only if you flip the right flags
Qwen3.8-27B ships a reasoning-effort dial and a 262K native context that stretches to 1M tokens with the right flags. The catch, buried in Alibaba's own guide: dialing the thinking down can slow agent pipelines. Here is what the flags do and when low effort backfires.
2026-09-18
Artificial Intelligence
DeepSeek-OCR 2 Brings Visual Causal Flow to Open-Source Document Understanding
DeepSeek-OCR 2 introduces Visual Causal Flow for human-like visual encoding. Now open-source on GitHub, the model supports vLLM and Transformers, dynamic resolution (up to 1,216 visual tokens), and document-to-markdown conversion.
2026-07-09
Artificial intelligence
Aleph alpha's new megakernel library cuts moe inference latency by 200%
Alpha-MoE fuses multiple operations into a single persistent kernel to achieve up to 200% inference speed gains over Triton-based kernels in vLLM and SGLang, targeting FP8-precision MoE models.
2026-07-09