The hidden tax on enterprise AI: Why data architecture is the ROI problem nobody budgeted for

Many large companies have spent the past few years investing in artificial intelligence infrastructure, software and implementation. Boards approved the plans. Finance built the business cases. Procurement negotiated for computing capacity. One question remained. How would they manage the data underneath those systems? This isn’t the kind of failure that makes headlines yet. There is no major outage, breach or recall. Instead, it is a quiet, compounding drag that appears as unplanned headcount and slipping timelines. Talk to enough infrastructure leaders about what happened and you’ll hear the phrase “data gravity” more than once. The scale of the problem is visible in the numbers. A 2025 report from MIT’s NANDA initiative found that 95% of enterprise generative AI pilots produced little or no measurable impact on the profit-and-loss statement. The report points to gaps in…