aiqbench analysis
NVIDIA's focus on maximizing tokens per megawatt addresses the critical ROI challenges facing operators with massive capital expenditures in AI infrastructure. By optimizing the entire stack from hardware to software, the company aims to extend the productive lifespan of GPUs and lower the cost per token, directly impacting the economic viability of large-scale AI factories.
NVIDIA GPUs help AI factories get the most tokens per megawatt
AI factories costing $60 million per megawatt need strong ROI, and NVIDIA is engineering solutions to maximize throughput.
With each AI factory now costing approximately $60 million to build, operators are intensely focused on return on investment. NVIDIA is engineering AI factories to maximize earnings, longevity and versatility, recognizing that strength in one area cannot compensate for weakness in another. The company achieves this through a platform designed to deliver the highest throughput per megawatt, extend hardware’s useful life and run any accelerated workload; NVIDIA CUDA-X libraries let a factory run any accelerated workload, the company says. This approach maximizes AI factory returns. This performance leap directly impacts…
Excerpt shown under the publisher's RSS terms · 90 words · full text and figures are on the publisher's site
Related coverage
Maximize AI Factory Energy Efficiency Through Full-Stack Inference and Training Optimizations
NVIDIA · Jun 23, 2026
AI Infra Summit: NVIDIA Vera Rubin and DSX Platform Advancements Showcase Energy Efficiencies of Optimizing Tokens Per Watt for AI Factories
NVIDIA · Sep 15, 2026
NVIDIA Vera Rubin Driving Performance Per Watt, Lowest Token Cost for Partners Worldwide
NVIDIA · Jul 21, 2026
NVIDIA Vera Rubin and Blackwell Set a New Standard for Agentic AI Performance per Watt
NVIDIA · Aug 24, 2026