AIFeatured5 min read
Agent Benchmark Analysis
ProgramBench: every public AI scores 0% on the hardest coding test yet
ProgramBench challenges AI agents to reconstruct programs from binaries alone, without source code or issue descriptions. All public models fail to fully resolve any task, exposing weaknesses in probing, architecture, and stopping judgment. The benchmark is a stress test for coding agents moving beyond patch-based workflows.
2026-06-29