aiqbench analysis
The article addresses a critical challenge for AI practitioners and engineering leaders: the disconnect between soaring enterprise spending on generative AI tools and measurable improvements in software delivery velocity. It argues that without moving beyond vanity metrics like token usage, organizations risk hitting bottlenecks where individual adoption fails to translate into organizational ROI. This analysis provides essential guidance for aligning AI strategy with actual development lifecycle outcomes rather than just tool proliferation.
Presentation: The Five Stages of AI Maturity in Engineering Organizations - Where and Why Teams Get Stuck

Quotient CEO Lizzie Matusov explains why soaring AI spend often fails to improve software delivery. She presents a research-backed AI maturity framework designed to help engineering leaders move beyond vanity metrics like token usage, align organizational AI adoption, and address critical bottlenecks across the software development life cycle to deliver measurable business outcomes. By Lizzie Matusov
Lizzie Matusov: My name is Lizzie Matusov. I am the co-founder and CEO of Quotient. We spend a lot of our time studying bottlenecks in software engineering, especially as those bottlenecks change with AI. I think one truth that all of us have felt is that innovation is moving very fast. If you're feeling like this movement is almost unprecedented in its nature, know that you're not alone in that feeling, because AI spend is moving faster than really anybody forecasted. Just in 2026, we've seen a 47% year-over-year growth in global AI spending. We are now projected to spend $2.5 trillion on AI, and 72% of enterprises are running at least one AI workload in production. That pace is exceptional. I think it goes to show that at this point, AI is a necessary part of how we build software. The thing is, when AI spend is moving faster than anyone has forecasted, that also means that we're blowing past all of our enterprise's expectations of that spend. Let's take Uber, for example. They recently announced that they had burned through their entire 2026 AI budget in just four months. That's one-third of the amount of time. Of course,…
Excerpt shown under the publisher's RSS terms · 200 words · full text and figures are on the publisher's site
Related coverage

Research Note: Filtering Subversion-Relevant Information From Pretraining Data Is Feasible
LessWrong · Oct 5, 2026

Presentation: Building Evals for AI Adoption: from Principles to Practice
InfoQ · May 29, 2026
State of Pandemic Early Warning
LessWrong · Sep 24, 2026

Building trust in AI agents: A production-ready evaluation framework with Amazon Bedrock AgentCore
AWS · Oct 16, 2026