CONNECT WITH US

Google TPUs to achieve over 70% share in in-house developed cloud ASIC accelerator market in 2024, says DIGITIMES Research

Stella Weng, DIGITIMES Research, Taipei 0

Credit: DIGITIMES

According to DIGITIMES Research's report on cloud ASIC accelerators, the global shipment of self-developed cloud AI ASIC accelerators is projected to reach 3.45 million units in 2024, with Google's market share expected to grow to 74%.

In the second half of 2024, Google will commence mass production of its latest sixth-generation TPU v6, which is equipped with Google TPU's dedicated optical network architecture, Lightwave Fabric. This will enhance energy efficiency and ensure that the TPU v6 SuperPOD maintains a high level of feasibility.

As a result, Google not only leads in market share for AI ASIC accelerators but also surpasses other cloud service providers (CSPs) in network architecture with its self-developed technology.

According to DIGITIMES Research, Google is projected to hold the highest global market share for self-developed cloud AI ASIC accelerators in 2024.

In 2023, Google's self-developed cloud AI ASIC accelerators held a market share of 71%. It is projected that their market share will grow to 74% in 2024. Besides having the highest market share, Google is also the earliest among the world's top three CSPs to develop its own AI ASIC accelerators, the report's figures show.

Since 2016, Google has introduced its first-generation TPU, and in the second half of 2024, Google will commence mass production of the latest sixth-generation TPU. The TPU v6 is expected to be fabricated using TSMC's 5nm process, primarily featuring the 8-layer HBM3, with Samsung as the HBM3 supplier.

Notably, Google has integrated its self-developed optical network architecture with the TPU v6 SuperPOD, positioning itself as a leader among CSP peers in terms of technology adoption and deployment scale.

Google has replaced its spine switches with self-developed all-optical switches. Unlike the typical circuit packet switching form, the optical circuit switch (OCS) employs direct all-optical switching. Compared to Broadcom's or Mellanox's switch solutions, this significantly reduces the power consumption and cost of the TPU SuperPOD.

Furthermore, Google's optical transceiver module has undergone multiple iterations, significantly enhancing both bandwidth and speed. Its rate has increased from duplex 200G in 2017 to duplex 800G by 2024, with an upgrade path towards duplex 1.6T. The single-channel rate has also seen substantial growth, upgrading from 50G PAM4 in 2017 to 200G PAM4 in 2024.