Microsoft plans huge deployment of its own AI chips, with an eye on saving costs
“Microsoft announced the next generation of its custom AI chip on Monday and said it plans to deploy potentially more than a million of them next year to back its internal AI services. The Maia 300, as…”
The Maia 300, as the chip is called, is the third generation of the company's custom chips designed to handle AI data crunching such as coding and carrying out complex business tasks on a user's behalf. Its predecessor is already running Microsoft's in-house AI models, as well as models from OpenAI delivered on Microsoft's Azure cloud computing service.
The new version comes amid a flurry of custom chips from bothcloud computing rivalsandAI firms such as OpenAIaimed at loosening the hold of Nvidia on the AI computing market. To construct the chip, Microsoft took a different technical path from Nvidia whose AI accelerators use one massive computing chip surrounded by high-bandwidth memory chips.
The central computing processor in Microsoft's Maia 300 silicon is composed of "chiplets" — typically specialized chips bonded together — that use 2-nanometer technology from Taiwan Semiconductor Manufacturing Co for key computing functions.
"Stay connected with Aman-e-Pakistan for ongoing live reporting and verified investigative updates."
Read More:Microsoft president says milk faces more regulation than AIOther chiplets included in the design use cheaper 3-nanometer tech for functions such as moving data off the processor and elsewhere inside the system.
The Maia 300 processors will go into racks that contain 96 chips and use about 167 kilowatts of power, compared with the 142 kilowatts used by Nvidia's most recent GB300 AI server racks with 72 of its graphics processing units (GPUs).
Microsoft said the Maia 300 chips will get about 40% more useful computing done per megawatt than "leading GPU-based systems," though it did not name the systems it used for a comparison.
"It's basically delivering more intelligence for every watt, every dollar, and every byte of memory by optimizing across the entire system," Rani Borkar, president of Azure hardware systems and infrastructure at Microsoft, in an interview. Microsoft said it plans to roll out "multi-gigawatt deployments" of the Maia 300 chip starting next year.
Microsoft has said itexpects to spendmore than $175 billion in capital expenditures this calendar year.
Continue Reading: More in Tech
Swipe or click arrows to explore Tech desk coverage
