multimodal
6 published articles
Multimodal / Open Source
Qwen plugin pack gives your coding agent eyes, hands, and video memory
Alibaba's Qwen team released Qwen-MM-Plugins, an Apache-2.0 toolkit that gives coding agents native multimodal skills: dynamic-resolution image and video reading, OCR, grounding, ASR, long-video memory, video generation, and thin-client control of Blender and FreeCAD. One script installs it across Claude Code, Codex, Qoder, OpenClaw, Qwen Code, and Gemini CLI.
2026-08-15
AI Safety
Shieldstral, the 3B classifier that outguns models seven times its size
A 3B safety classifier matches text models nearly seven times its size and sets a new multimodal moderation state of the art, per a July 2026 arXiv paper. The trick: moderation reframed as binary question answering, trained on roughly 54.1 million samples.
2026-08-05
Artificial Intelligence
Inkling is open-source AI's $53 billion reality check
Inkling is the first openly available near-1T parameter model with native audio, image, and text input alongside a 1M-token context window. The raw benchmark scores are strong. The real story is how the open-source ecosystem has moved from playing catch-up to competing at the frontier, and where Inkling fits on that new map.
2026-07-15
State of the art
Fifteen articles on AI generation reveal three shifts that matter more than any single model
A 15-article series on AI generation reveals three shifts that matter more than any single model: multimodal pipelines have become routine, agentic orchestration is replacing manual chaining, and real-time feedback is turning generation from a gamble into a conversation.
2026-07-11
Artificial Intelligence
MiniMax's M3 just beat Opus 4.7 at browsing, trained itself, and never asked for help
MiniMax M3 delivers a 9.4x CUDA kernel speedup, beats Opus 4.7 on BrowseComp, and autonomously replicated an ICLR paper. All in an open-weight package, and it never asked for help.
2026-07-06
Open source innovation
Hugging Face's Moon Bot turns Slack into a coding agent, and that's just this week
Moon Bot brings AI-assisted coding directly into Slack workflows, while VLX-Flow and VLX-Seek tackle real-time video understanding and fine-grained perception. Other highlights include a medical encoder pretraining recipe, QLORA distillation experiments on Qwen, and an extraterrestrial benchmark for machine learning.
2026-06-29