Why Frontier Agents Fail Real Engineering Work: Two Terminal-Bench 3.0 Task Deep Dives

Terminal-Bench 3.0 (formerly Frontier-Bench) recently launched, built to track what AI agents can and can’t do across real computer work. Terminal-Bench 2.1 has been saturating, with top agents reaching 84%; on Terminal-Bench 3.0, the best model, Claude Opus 5, achieves just 43.5%. Terminal-Bench 3.0 raises the bar with 74 authentic, verifiable tasks across 7 domains, designed to expose meaningful gaps in agent reasoning and execution. Snorkel AI helped strengthen that quality system, with support through the Open Benchmarks Grants program: shaping the QA process, building the category taxonomy, running benchmark-wide testing and corrections, and authoring expert launch tasks spanning real-world systems debugging and ML infrastructure. Our tasks are included in the Terminal-Bench 3.0 launch set, and the team continues to support the benchmark’s evolution. The two deep dives below illustrate the kinds of judgment the benchmark is designed to capture. First, we’ll look at session-window-debug, a streaming pipeline where every individual…