US Hyperscalers Set to Deploy Over 5 Million AI Training-Capable Accelerators in 2024
REDWOOD CITY, Calif. –December 19, 2024 – According to a recently published report by Dell’Oro Group, the trusted source for market information about the telecommunications, security, networks, and data center industries, revenue for accelerators, consisting of GPUs and custom accelerators, increased by 130 percent in 3Q 2024. The US hyperscalers―Amazon, Google, Meta, and Microsoft―are set to deploy over 5 million AI training-capable accelerators in 2024.
“Demand for accelerators has been growing at a breakneck pace as the hyperscalers race to deploy infrastructure for the training and inference of large language models,” said Baron Fung, Senior Research Director at Dell’Oro Group. “In addition to commercially available GPUs, the US hyperscalers are also increasing their deployment of AI infrastructure with custom accelerators. As large language models continue to grow in size, driving the need for larger compute clusters, hyperscalers are accelerating their adoption of custom accelerators. Often co-developed with chipmakers like Broadcom and Marvell, these custom solutions aim to boost performance efficiency, lower costs, and reduce dependency on NVIDIA GPUs,” Fung added.
Additional highlights from the 3Q 2024 Data Center IT Semiconductors and Components Quarterly Report:
- The Server and Storage Systems Component market is forecast to increase by over 100 percent in 2024. Accelerators, followed by memory and storage drives drove the incremental growth.
- NVIDIA dominated component revenues, leading all vendors, with Samsung and SK Hynix trailing behind. NVIDIA captured nearly half of the total reported revenues, while hyperscalers deploying custom solutions are rapidly gaining ground.
- Smart NIC and DPU revenues nearly doubled in 3Q 2024, driven by strong deployment of network adapters in AI clusters.
- Growth is expected to moderate to still a healthy double-digit increase in 2025, with a potential slowdown in general-purpose server components early in the year due to inventory adjustments.
Dell’Oro Group’s Data Center IT Semiconductors and Components Quarterly Report tracks revenue, unit and capacity shipments and unit and capacity pricing, along with market share of major semiconductor and component manufacturers that supplies into the data center server and storage system markets starting from 2018. Technology of focus will be major server and storage semiconductors and components such as CPUs, accelerators such as GPUs, FPGAs, and custom AI ASICs, Ethernet and InfiniBand NICs and Smart NICs, HDDs, NAND/SSDs. In addition, we will provide a forecast of the demand for these components based on shipments of servers and storage system to the hyperscale cloud service providers and to the rest-of-the-market. To purchase this report, please contact us at dgsales@delloro.com.
Dell’Oro Group is a market research firm that specializes in strategic competitive analysis in the telecommunications, security, enterprise networks infrastructure, and data center markets. Our firm provides in-depth quantitative data and qualitative analysis to facilitate critical, fact-based business decisions. For more information, contact Dell’Oro Group at +1.650.622.9400 or visit www.delloro.com.
# # #
