aiqbenchInformații despre AI & calcul cuantic

...

Română · beta. Traducerea a fost făcută automat și este încă în curs de revizuire. Citește pagina în engleză

perspectiva aiqbenchCipuri & infrastructură

Microsoft's Maia roadmap is an AI hardware story: a multi-gigawatt inference commitment built on a custom accelerator and an Ethernet-based scale-up and scale-out fabric. Readers should weigh the architectural details, such as HBM bandwidth, NUMA memory layout, and KV-state handling between prefill and decode, more heavily than the headline tokens-per-watt figure, which practitioners have questioned and which Microsoft has not fully substantiated. The announcement also says little about training, so its relevance is clearest for inference-cost and deployment planning.

Sursă care acoperăInfoQ

Ce este aceastaLectura unui model asupra articolului și a acoperirii conexe, scrisă pentru aiqbench. Nu sunt cuvintele publicației.

Microsoft Commits Maia to Multi-Gigawatt Inference, and its Efficiency Metric Draws Questions

InfoQ16 octombrie 20265 min de cititArticolul și perspectiva sunt în engleză.

Microsoft will scale its Maia accelerator family to multi-gigawatt deployments from 2027, making it the primary inference system for its own products. Maia 300 collapses scale-up and scale-out onto one Ethernet fabric and moves KV state between prefill and decode workers without leaving it. Practitioners have questioned the tokens-per-watt claim that leads the announcement. By Steef-Jan Wiggers

Microsoft will scale its Azure Maia family to multi-gigawatt deployments starting in 2027, making Maia "the primary inference system for Microsoft products and services." The architecture behind that commitment is unusually specific about data movement. The efficiency claim leading the announcement is not, and practitioners have said so. Maia 200 is already in production, serving Microsoft Copilot and the MAI team, with GitHub Copilot and Microsoft Foundry to follow by the end of the year. It is deployed across the United States, Europe, and Australia, and Microsoft says it delivers up to…

Extras afișat conform termenilor RSS ai publicației · 92 cuvinte · textul integral și figurile sunt pe site-ul publicației

Citește pe InfoQ ↗Întreabă despre acest articol