[wp_tech_share]

Greetings! Prior to delving into an evaluation of our data center predictions for 2024, allow me to first revisit some of the prominent trends I emphasized in the 2023 predictions blog.

    • Data center capex growth in 2023 has decelerated noticeably, as projected after a surge of spending growth in 2022. The top 4 US cloud service providers (SPs) in aggregate slowed their capex significantly in 2023, with Amazon and Meta undergoing a digestion cycle, while Microsoft and Google are on track to increase their greenfield spending on accelerated computing deployments and data centers. The China Cloud SP market remains depressed as cloud demand remains soft from macroeconomic and regulatory headwinds, although there are signs of a turnaround in second-half 2023 from AI-related investments. The enterprise server and storage system market performed worse than expected, as most of the OEMs are on track to experience a double-digit decline in revenue growth in 2023 from a combination of inventory correction, and lower end-demand given the economic uncertainties. However, network and physical infrastructure OEMs have fared better in 2023 because strong backlog shipments fulfilled in the first half of 2023 which lifted revenue growth.
    • We underestimated the impact of accelerated computing investments to enable AI applications in 2023. During that year, we saw a pronounced shift in spending from general-purpose computing to accelerated computing and complementary equipment for network and physical infrastructure. AI training models have become larger and more sophisticated, demanding the latest advances in accelerators such as GPUs and network connectivity. The high cost of AI-related infrastructure that was deployed helped to offset the sharp decline in the general-purpose computing market. However, supplies on accelerators have remained tight, given strong demand from new hyperscale.
    • General-purpose computing has taken a backseat to accelerated computing in 2023, despite significant CPU refreshes from Intel and AMD with their fourth-generation processors. These new server platforms feature the latest in server interconnect technology, such as PCIe 5, DDR5, and more importantly CXL. CXL has the ability to aggregate memory usage across servers, improving overall utilization. However, general-purpose server demand has been soft, and the transition to the fourth-generation CPU platforms has been slower than expected (although AMD made significant progress in 3Q23). Furthermore, CXL adoption is limited to the hyperscale market, with limited use cases.
    • Server connectivity is advancing faster than what we had expected a year ago. In particular, accelerated computing is on a speed transition cycle at least a generation ahead of the mainstream market. Currently, accelerated servers with NVIDIA H100 GPUs feature network adapters at up 400 Gbps with 112 Gbps SerDes, and bandwidth will double in the next generation of GPUs a year from now. Furthermore, Smart NIC adoption continues to gain adoption, though, mostly limited to the hyperscale market. According to our Ethernet Adapter and Smart NIC report, Smart NIC revenues increased by more than 50% in 2023.
    • The edge computing market has been slow to materialize, and we reduced our forecast in the recent Telecom Server report, given that the ecosystem and more compelling use cases need to be developed, and that additional adopters beyond the early adopters have been limited.

According to our Data Center IT Capex report, we project data center capex to return to double-digit growth in 2024 as market conditions normalize. Accelerated computing will remain at the forefront of capex plans for the hyperscalers and enterprise market to enable AI-related and other domain specific workloads. Given the high cost of accelerated servers and their specialized networking and infrastructure requirements, the end-users will need to be more selective in their capex priorities. While deployments of general-purpose servers are expected to rebound in 2024, we believe greater emphasis will be made to increase server efficiency and utilization, while curtailing cost increases.

Below, we highlight key trends that can enhance the optimization of the overall server footprint and decrease the total cost of ownership for end-users:

Accelerated Computing Maintains Momentum

We estimate that 11% of the server unit shipments are accelerated in 2023, and are forecast to grow at a five-year compound annual growth rate approaching 30%. Accelerated Servers contain accelerators such as GPUs, FPGAs, or custom ASICs, and are more efficient than general-purpose servers when matched to domain-specific workloads. GPUs will likely remain as the primary choice for training large AI models, as well as running inference applications. While NVIDIA currently has a dominant share in the GPU market, we anticipate that other vendors such as AMD and Intel will gain some share over time as customers seek greater vendor diversity. Greater choices in the supply chain could translate to much-needed supply availability and cost reduction to enable sustainable growth of accelerated computing. Refer to our Data Center IT Semiconductors & Components report for more insights on the accelerator and server component market.

Advancements in Next-Generation Server Platform

General-purpose servers have been increasing in compute density, as evolution in the CPUs is enabling servers with more processor cores per CPU, memory, and bandwidth. Ampere Computing Altra Max, AMD’s Bergamo are offered with up to 128 cores per processor, and Intel’s Granite Rapids (available later this year), will have a similar number of cores per processor. Less than seven years ago, Intel’s Skylake CPUs were offered with a maximum of 28 cores. The latest generation of CPUs also contains onboard accelerators that are optimized for AI inference workloads.

Lengthening of the Server Replacement Cycle

The hyperscale cloud SPs have lengthened the replacement cycle of general-purpose servers. This measure has the impact of reducing the replacement cost of general-purpose servers over time, enabling more capex to be allocated to accelerated systems.

Disaggregation of Compute, Memory, and Storage

Compute and storage have been disaggregated in recent years to improve server and storage system utilization. We believe that next-generation rack-scale architectures based on CXL will enable a greater degree of disaggregation, benefiting the utilization of compute cores, memory, and storage.

[wp_tech_share]

As we enter the new year, it’s a great opportunity to reflect on 2023 and assess what’s in store for 2024.

Looking back at our 2023 DCPI predictions, we anticipated that macroeconomic uncertainty would not lead to a DCPI recession in 2023. We also foresaw that power availability would challenge data centers to rethink energy storage and on-site power generation. Both proved to be true.

Through 3Q23, DCPI revenues have grown at double-digit rates, surpassing our expectation for 2023. Power availability also became a widespread topic of conversation, with battery energy storage systems (BESS), fuel cells, and small modular reactors (SMRs) all increasingly viewed as options to address future power availability challenges.

We also predicted a 10MW immersion cooling deployment from a top cloud service provider; however, this did not happen. Smaller scale deployments and proof of concepts occurred, but larger scale deployments require continued growth in ecosystem support, new environmentally friendly immersion fluids, and increased end-user operational readiness.

Yet, the most impactful and exciting development of 2023 in the data center industry should come as no surprise at this point, the proliferation of generative AI. This has set the stage for a profound transformation in the DCPI market. The impact will be felt for years to come, and we expect to see the following three trends this year:

  1. Normalizing order cycle to lead to slow start for DCPI market in 2024

After back-to-back years of double-digit growth, which has not been the norm over the past decade, DCPI revenue growth is forecast to moderate in 2024, pronounced in the first half of the year. This moderation is attributed to supply chain constraints that delayed unit shipments in 2022, creating unseasonably strong growth in the first half of 2023. Not only does this create tough year-over-year comparisons for 1H24, but abated supply chain constraints mean end-users’ ordering patterns are normalizing, shifting towards the second half of the year.

Additionally, while DCPI vendor backlogs haven’t meaningfully declined, the contents of those backlogs have changed. Order associated with traditional computing workloads have returned to more normal levels, while backlogs for AI-related DCPI deployments are growing. However, these AI-related DCPI deployments need additional time to materialize.

  1. Purpose-built AI facilities will begin to materialize in 2H24

After a slow first half of the year, growth is forecast to accelerate during the second half of 2024. We anticipate that this growth will be driven by new facilities purpose-built for AI workloads, starting to materialize from the top cloud service providers. These facilities are expected to demand 100s of MWs each, pushing rack power densities from 10 – 15 kW/rack today to 80 – 100 kW/rack to support power hungry accelerated servers.

This requires significant investments in higher ampacity power distribution and thermal management, specifically liquid cooling. We expect the majority of this liquid cooling to materialize in the form of Direct Liquid Cooling and air-assisted Rear Door Heat Exchangers (RDHx). This is due to the familiarity of end-users deploying IT infrastructure in the vertical rack form factor and existing ecosystem support, alongside the performance and sustainability benefits. We plan to provide more detail on liquid cooling in our upcoming Advanced Research Report, Data Center Liquid Cooling,’ scheduled to publish in 2Q24.

  1. Changes in GHG Protocol accounting will add pressure to data center sustainability

The data center industry is on a rapid growth trajectory, a trend further accelerated by the growth of AI workloads. However, this surge has raised concern about a potential for alarming growth in greenhouse gas (GHG) emissions. This has attracted attention to the data center industry, to which the industry has responded with commitments to grow sustainably.

To help measure and assess progress here, many within the data center ecosystem report on carbon emissions following the GHG Protocol Corporate Accounting and Reporting Standard. GHG Protocol recently began working on updates to the standards that may significantly impact data center Scope 2 emissions, or indirect emissions generated from the purchase of electricity. Historically, data center owners and operators have been able to limit these emissions through power purchase agreements (PPAs) and renewable energy certificates (RECs) offsets. However, these offsets no longer have the shiny appeal they once did. That’s because the burden a data center has on its local power grid and community may not align with the benefits from the offsets.

We expect the updates from GHG Protocol to address this issue, and become introduce more granularity and stringency in Scope 2 emissions accounting. This may make sustainability claims related to Scope 2 emissions more difficult to make, but much more meaningful. A draft version of these updates is expected in 2024, with the final standards slated for release in 2025. These changes will set the stage for the sustainability claims the data center industry can make in the second half of this decade.

[wp_tech_share]

Happy New Year! We couldn’t hope for a more exciting start to the year than with the groundbreaking announcement that HPE has entered into a definitive agreement to acquire Juniper. In this blog, we delve into the potential impact of this acquisition on the market, along with additional predictions for what 2024 may have in store for us:

  1. The Campus Switch Market is on the Verge of a Correction in 2024

Right before the holidays, we published our 3Q23 reports which provided an overview of the market performance for the first nine months of 2023. Based on those results, the market is estimated to have grown strong double-digits in 2023, marking the third consecutive year of a very robust growth. As a reminder, the typical growth rate in the campus switch market, pre-pandemic, has been in the low-to-mid single digits. The outstanding performance in the last couple of years begs the question: where do we go from here? Based on our interviews with the vendors as well as value-added resellers (VARs) and system integrators (SIs), we believe the market is poised for a correction in 2024. We anticipate the demand in the market to slow down significantly as customers absorb and digest existing capacity. Additionally, conversations with key vendors indicate their anticipation of a return to normal backlog levels by the beginning of 2024. Once the backlog is restored to its typical state, sales performance will more accurately mirror organic market demand, eliminating the potential for backlog-driven inflation

2. HPE/Juniper acquisition Will create a Tectonic Shift in the Market

While the HPE/Juniper acquisition may not be finalized until the end of the year, we anticipate witnessing its impact on the market and competitive landscape throughout 2024. We foresee other vendors accelerating the pace of innovation and product introductions, anticipating potential synergies created by the combined HPE/Juniper entity, as explained in my HPE/Juniper blog. Additionally, we expect employees to transition between companies, fostering cross-pollination. Monitoring customer reactions will be crucial throughout the year. We believe the HPE/Juniper deal may further amplify the anticipated pause in market demand as customers will be seeking clarity on how the acquisition will impact future roadmaps.

3. AI capabilities will increasingly define the competitive landscape in the market

In the midst of intense competition and an expected slowdown in market demand, vendors find themselves compelled to enhance their offerings with AI capabilities. The addition of these AI capabilities brings several benefits, including product differentiation, increased demand for new use cases and applications, acceleration in product refresh cycles, and higher customer retention. However, it remains intriguing to observe vendors’ ability to effectively monetize these features. Furthermore, as customers weigh the options between on-premises and cloud-managed solutions, as well as subscription versus perpetual consumption models, we believe that AI features will play a pivotal role in influencing these choices. Customers are likely to opt for the model that allows them to benefit the most from these AI features.

For more detailed views and insights on the campus switch market, please contact us at dgsales@delloro.com

[wp_tech_share]

Early last year, we predicted that the enterprise class WLAN revenues would surpass $10 B in 2023 and that sales would be weighted to the first half of the year, defying the usual seasonal patterns.  Although 4Q23 results have not yet been published, the first three quarters of the year indicate that 2023 is unfolding as we anticipated.

In the first half of 2023, manufacturers shipped more Access Points (AP) than any first half in history.  In the aftermath of the pandemic, a lack of components had created pent-up demand, just as businesses wanted to adapt their networks to accommodate hybrid work models.  With equipment in short supply, prices rose and were locked into orders awaiting fulfillment. Once the shortages were alleviated, unit shipments flooded into the channels and manufacturers recognized record revenues.

The good times showed signs of waning in 3Q23, as it became evident that the distribution channels were holding excess equipment, and enterprises needed time to deploy the high volumes of units that had shipped.  This led to a drop in unit shipments from manufacturers, with the blow to revenues softened by growth in average prices.

The party may be over, at least temporarily, for the WLAN market; but scratching the surface, there were a couple of gems in 2023 that point to longer-term expansion.

First, use of the new 6 GHz band for Wi-Fi expanded.  The spectrum was approved for unlicensed use in the US in 2020, but worldwide shipments of APs supporting the new band stayed below 3% until 2023.  In 3Q23, Wi-Fi 6E shipments rose to 10% of units shipped, representing almost a quarter of worldwide revenues.  Wi-Fi 6E shipments grew despite a lack of coordination by worldwide regulatory bodies regarding which portions, if any, of the 6 GHz band are allocated for unlicensed (Wi-Fi) use.  Then, as the cherry on the 6 GHz sundae, Wi-Fi 7 APs became commercially available for enterprises in 2023. The new standard (also known as 802.11be) promises higher throughput and lower latencies and will operate in 6 GHz where available, but it will also work in the legacy frequency bands.

Second, AIOps and network automation moved to the forefront of IT decision making.  Manufacturers introduced new AI-driven operations features for troubleshooting and recommending configuration changes.  Startup Wi-Fi vendors marketed services based on fully automated network operations. Enterprises who deployed AIOps began reporting a dramatic reduction in network trouble tickets.  In 2023, the automation of network operations became a paragon of AI’s value proposition to enterprises.

This context leads us to the following predictions for the WLAN market in 2024:

  1. The WLAN digestion period will take hold and continue well into 2024

It will take several quarters for the excess WLAN equipment to clear itself from the distribution channels and enterprises’ inventories.  In addition, some enterprises are concerned about the economic context and are elongating their decision-making.  We project an overall contraction in WLAN revenues in 2024, especially given the record high sales that occurred in 2023.

  1. Wi-Fi 6E adoption will begin to decline as the availability of Wi-Fi 7 expands

There are already 6 vendors selling Wi-Fi 7 APs to enterprises, and the rest of the major vendors are expected to introduce Wi-Fi 7 APs in 2024.  Over the course of 2024, vendors will ship more Wi-Fi 6E than Wi-Fi 7 APs. However, 2024 will be the year that Wi-Fi 7 establishes a hold on the market.  As a broader range of configurations becomes available, sales of Wi-Fi 7 will begin to displace sales of Wi-Fi 6E.  Wi-Fi 7 adoption is expected to grow significantly over the next few years, representing 45% of the Indoor APs shipped in 2027.

  1. Software revenues will dampen the effects of lower unit shipments

As WLAN management applications add features that enterprises value, enterprises are more likely to accept the associated recurring costs.  The results from 3Q23 showed an early indication that the market is entering into a digestion period:  unit shipments dropped by 14% year-over-year and AP revenues contracted by 10%.  Meanwhile, Controller & Licenses revenue grew by over 20%.  The recurring license fees paid by the installed base of users helped to grow this line item, even as unit shipments dropped. This phenomenon may soften the downturn, especially for the vendors who have managed to shift their customer base to a recurring model.

  1. Campus NaaS will gain traction as enterprises focus their priorities

In last year’s predictions, we indicated that some clarity was needed to define Campus Network as a Service (Campus NaaS) offers – many manufacturers were using the term NaaS to mean different things.  In our June 2023 report, we were able to broadly categorize the offers into three groups: Enabler, Turnkey, and Wi-Fi as a Utility.  Since then, more vendors have begun to offer LAN equipment and software in cloud consumption model, and the offers have begun to appeal to a broader set of enterprise verticals.  In 2024, the definition of Campus NaaS should become even crisper, and enterprises will begin to consider the service as a way to outsource their IT connectivity, allowing them to focus on their core business priorities.

 

[wp_tech_share]

“Inventory Correction,”“Inventory Realignment,” Or whatever term you prefer to call the root cause of 2023’s broadband spending slowdown will likely persist well into 2024. Without the benefit of fourth quarter numbers, total spending on broadband equipment in 2023 is expected to show a decline of around 10%. Early projections for 2024 indicate an additional 5% year-over-year decrease, as the lagging impact of interest rate increases to curb inflation will be felt more acutely. This additional 5% decrease would put total spending to around $16.5 B—roughly equal to 2021 spending levels.

The expected declines in 2023 and 2024 follow three straight years of white-hot growth in broadband network and service investments from 2020 to 2022. During this period,  year-over-year growth rates reached 9%, 15%, and 17%, respectively. Similar periods of growth from 2003-2006 and 2010-2014 were both followed by two subsequent years of reduced spending, as operators—particularly in China—shifted their capital expenditure focus from broadband to mobile RAN.

The silver lining here is that very early signals regarding 2025 show a return to growth, as BEAD and other subsidization efforts begin to trickle down to broadband equipment suppliers. Well before that, pockets of growth in fixed wireless CPE, cable DAA equipment and CPE, and continued spending on PON equipment by tier 2 and tier 3 operators should make the broadband market one in which the headlines might communicate malaise, but a peek under the hood shows clear signs of resilience powering an inevitable return to growth.

Here is what we are expecting in this coming year:

Cable Operators Travel Different Paths to Fend off Fixed Wireless and Fiber

Just like last year, in the minds of cable consumers, cable operators find themselves stuck battling against the perception that they are the provider with inferior copper technology that can’t be flexible when it comes to offering plans that meet a consumer’s budget, like fixed wireless currently can. As a result of this situation, larger cable operators are seeing increased broadband subscriber churn and quarters of net subscriber losses.

Comcast is pushing hard to counter those perceptions and is already offering its X-Class Internet tiers, which offer symmetrical speeds of 2 Gbps in Atlanta, Colorado Springs, and Philadelphia. Additional cities are expected to roll out these service tiers in 2024. Comcast’s use of full-duplex DOCSIS 4.0 (FDX), including brand new CPE using Broadcom’s D4.0 silicon in a two-box configuration. Later this year, we expect to see a combined gateway that also incorporates Wi-Fi 7, as Comcast looks to battle back against FTTH providers by providing the most advanced residential gateway to customers.

Meanwhile, in 2024, Charter’s Remote PHY and vCMTS rollouts will kick into high gear. (At the time of this publication, we are awaiting fourth quarter earnings from both Harmonic and Vecima, the announced RPD partners for Charter’s buildout to determine how much equipment the operator purchased in advance of this significant deployment.) For Charter, which is employing Extended Spectrum DOCSIS 4.0, 2024 will also bring much wider availability of 1.8 GHz amplifiers and taps, as well as a choice of CPE with dedicated silicon for ESD, as well as silicon that combines both FDX and ESD variants.

Charter will likely also announce additional vendors for its upgrade efforts, as the operator has been public about its desire for a multi-vendor environment.

Cox will also begin rolling out 1.8 GHz amplifiers this year but, like Charter, will likely run those at 1.2 GHz until taps and CPE become more widely available.

Meanwhile, for those operators that weren’t part of the initial DOCSIS 4.0 Joint Development Agreement (JDA) with Broadcom (and for some of those who were), DOCSIS 3.1 Plus is quickly becoming an important stopgap measure to help increase throughput within the existing DOCSIS 3.1 framework by leveraging additional OFDM channels. Operators can either use existing integrated CCAP chassis (with either legacy line cards supporting 3 OFDM blocks or newer cards supporting 4 OFDM blocks) or vCMTS platforms. This can be combined with either DOCSIS 4.0 modems or modems designed specifically for D3.1 Plus deployments, which won’t require the additional gain amplifier (and cost) needed for full DOCSIS 4.0.

While it remains to be seen which type of CPE operators deploying DOCSIS 3.1 Plus will move forward with, the fact that there is significant interest in the technology means that there will now be additional operators who will likely move on from DOCSIS 4.0 and instead buy themselves time with DOCSIS 3.1 Plus before moving forward with fiber overbuilds. The biggest question here is just how many operators will do so.

Speaking of fiber, we expect to see additional FTTH deployments—both greenfield and overbuild—by cable operators around the world. Whether using Remote OLT platforms or more traditional OLT platforms, cable operators will take advantage of work being done at CabeLabs to standardize the integration of ITU PON into existing DOCSIS management frameworks. This will make it far easier for MSOs to deploy XGS-PON, as well as 25GS-PON and, potentially 50G- and 100G-PON.

XGS-PON to Dominate Fiber Spend This Year

The PON equipment market will be the most dynamic this year, with tier 1 operators outside of BT OpenReach and Deutsche Telekom, all continuing to better align their inventories with anticipated subscriber growth, as well as reduced homes passed goals. For larger tier 1s, the short-term reduction in homes passed goals will ultimately give way to a renewed construction phase beginning in 2025 that should propel the overall PON market through the end of the decade.

But while the tier 1s slow, there will be no slowing the continued efforts by tier 2 and tier 3 operators in both North America and Europe to both upgrade and expand their fiber networks. In fact, the same dynamic that played out in North America in 2023 will likely repeat in 2024, as tier 2, tier 3, utilities, municipalities, and co-ops all continue their buildouts.

The technology beneficiary will be XGS-PON, which already surpassed 2.5 Gbps GPON revenue back in 2022, but will more than double it in 2024. And in markets where operators are beginning to see cable operators deliver symmetric 2 Gbps services, there is a strong chance they will also sprinkle in some 25GS-PON to comfortably deliver symmetric 5-10 Gbps services.

Meanwhile in China, which is expected to show a marked decline in new OLT port shipments in 2023, will likely see another decline until 50G-PON rollouts begin in earnest later this decade. On the flip side, ONT unit shipments in China are expected to increase as FTTR (Fiber to the Room) deployments expand, delivering 2-3 ONTs per home as opposed to the traditional architecture of using a single ONT to terminate fiber.

Wi-Fi 7 Progress Will Accelerate

With the Wi-Fi Alliance recently announcing the opening of certification testing for Wi-Fi 7 products, don’t be surprised to see dozens of Wi-Fi 7 residential routers and broadband CPE models being deployed by operators by the end of this year. Early gateway models, though pricey, have already been introduced to the market and will become much more widely available this Spring, and then well before the Holiday season. As of our July 2023 forecast, we expect over 2.5 million residential Wi-Fi routers and broadband gateways to ship in 2024, though we are undoubtedly increasing this forecast based on the certification testing opening up.

Operators can’t wait to deploy Wi-Fi 7 products to help differentiate themselves in increasingly crowded broadband markets and to eliminate much of the confusion in the market with the coexistence of Wi-Fi 6 and Wi-Fi 6E.