Chip engineer handling a wafer. Compared to Nvidia’s export-restricted chips, the performance gap between Huawei and the H20 is less than a full generation,” said Dylan Patel, founder, CEO and chief analyst of SemiAnalysis.
Sinology | Moment | Getty Images
With the U.S. restricting China from buying advanced semiconductors used in artificial intelligence development, Beijing is placing hopes on domestic alternatives such as Huawei.
The task has been made more challenging by the fact that U.S. curbs not only inhibit China’s access to the world’s most advanced chips, but also restrict availing technology vital for creating an AI chip ecosystem.
Those constraints span the entire semiconductor value chain, ranging from design and manufacturing equipment used to produce AI chips to supporting elements such as memory chips.
Beijing has mobilized tens of billions of dollars to try to fill those gaps, but while it has been able to “brute force” its way into some breakthroughs, it still has a long way to go, according to experts.
“U.S. export controls on advanced Nvidia AI chips have incentivized China’s industry to develop alternatives, while also making it more difficult for domestic firms to do so,” said Paul Triolo, partner and senior vice president for China at advisory firm DGA-Albright Stonebridge Group.
Here’s how China stacks up against the rest of the world in four key segments needed to build AI chips.
AI chip design
Nvidia is regarded as the world’s leading AI chip company, but it’s important to understand that it doesn’t actually manufacture the physical chips that are used for AI training and computing.
Rather, the company designs AI chips, or more precisely, graphics processing units. Orders of the company’s patented GPU designs are then sent to chip foundries — manufacturers that specialize in the mass production of other companies’ semiconductor products.
While American competitors such as AMD and Broadcom offer varying alternatives, GPU designs from Nvidia are widely recognized as the industry standard. The demand for Nvidia chips is so strong that Chinese customers have continued to buy any of the company’s chips they can get their hands on.
But Nvidia is grappling with Washington’s tightening restrictions. The company revealed in April that additional curbs had prevented it from selling its H20 processor to Chinese clients.
Nvidia’s H20 was a less sophisticated version of its H100 processor, designed specifically to skirt previous export controls. Nevertheless, experts say, it was still more advanced than anything available domestically. But China hopes to change that.
In response to restrictions, more Chinese semiconductor players have been entering the AI processor arena. They’ve included a wide array of upstarts, such as Enflame Technology and Biren Technology, seeking to soak up billions of dollars in GPU demand left by Nvidia.
But no Chinese firm appears closer to providing a true alternative to Nvidia than Huawei’s chip design arm, HiSilicon.
Huawei’s most advanced GPU in mass production is its Ascend 910B. The next-generation Ascend 910C was reportedly expected to begin mass shipments as early as May, though no updates have emerged.
Dylan Patel, founder, CEO and chief analyst at SemiAnalysis, told CNBC that while the Ascend chips remain behind Nvidia, they show that Huawei has been making significant progress.
“Compared to Nvidia’s export-restricted chips, the performance gap between Huawei and the H20 is less than a full generation. Huawei is not far behind the products Nvidia is permitted to sell into China,” Patel said.
He added that the 910B was two years behind Nvidia as of last year, while the Ascend 910C is only a year behind.
But while that suggests China’s GPU design capabilities have made great strides, design is just one aspect that stands in the way of creating a competitive AI chip ecosystem.
AI chip fabrication
To manufacture its GPUs, Nvidia relies on TSMC, the world’s largest contract chip foundry, which produces most of the world’s advanced chips.
TSMC complies with U.S. chip controls and is also barred from taking any chip orders from companies on the U.S. trade blacklist. Huawei was placed on the list in 2019.
That has led to Chinese chip designers like Huawei to enlist local chip foundries, the largest of which is SMIC.
SMIC is far behind TSMC — it’s officially known to be able to produce 7-nanometer chips, requiring less advance tech than TSMC’s 3-nanometer production. Smaller nanometer sizes lead to greater chip processing power and efficiency.
There are signs that SMIC has made progress. The company is suspected to have been behind a 5-nanometer 5G chip for Huawei’s Mate 60 Pro, which had rocked confidence in U.S. chip controls in 2023. The company, however, has a long way to go before it can mass-produce advanced GPUs in a cost-efficient manner.
According to independent chip and technology analyst Ray Wang, SMIC’s known operation capacity is dwarfed by TSMC’s.
“Huawei is a very good chip design company, but they are still without good domestic chipmakers,” Wang said, noting that Huawei is reportedly working on its own fabrication capabilities.
But the lack of key manufacturing equipment stands in the way of both companies.
Advanced Chip equipment
SMIC’s ability to fulfill Huawei’s GPU requirements is limited by the familiar problem of export controls, but in this case, from the Netherlands.
While Netherlands may not have any prominent semiconductor designers or manufacturers, it’s home to ASML, the world’s leading supplier of advanced chipmaking equipment — machines that use light or electron beams to transfer complex patterns onto silicon wafers, forming the basis of microchips.
In accordance with U.S. export controls, the country has agreed to block the sale of ASML’s most advanced ultraviolet (EUV) lithography machines. The tools are critical to making advanced GPUs at scale and cost-effectively.
EUV is the most significant barrier for Chinese advanced chip production, according to Jeff Koch, an analyst at SemiAnalysis. “They have most of the other tooling available, but lithography is limiting their ability to scale towards 3nm and below process nodes,” he told CNBC.
SMIC has found methods to work around lithography restrictions using ASML’s less advanced deep ultraviolet lithography systems, which have seen comparatively fewer restrictions.
Through this “brute forcing,” producing chips at 7 nm is doable, but the yields are not good, and the strategy is likely reaching its limit, Koch said, adding that “at current yields it appears SMIC cannot produce enough domestic accelerators to meet demand.”
SiCarrier Technologies, a Chinese company working on lithography technology, has reportedly been linked to Huawei.
But imitating existing lithography tools could take years, if not decades, to achieve, Koch said. Instead, China is likely to pursue other technologies and different lithography techniques to push innovation rather than imitation, he added.
AI memory components
While GPUs are often identified as the most critical components in AI computing, they’re far from the only ones. In order to operate AI training and computing, GPUs must work alongside memory chips, which are able to store data within a broader “chipset.”
In AI applications, a specific type of memory known as HBM has become the industry standard. South Korea’s SK Hynix has taken the industry lead in HBM. Other companies in the field include Samsung and U.S.-based Micron.
“High bandwidth memory at this stage of AI progression has become essential for training and running AI models,” said analyst Wang.
As with the Netherlands, South Korea is cooperating with U.S.-led chip restrictions and began complying with fresh curbs on the sale of certain HBM memory chips to China in December.
In response, Chinese memory chip maker ChangXin Memory Technologies, or CXMT, in partnership with chip-packaging and testing company Tongfu Microelectronics, is in the early stages of producing HBM, according to a report by Reuters.
According to Wang, CXMT is expected to be three to four years behind global leaders in HBM development, though it faces major roadblocks, including export controls on chipmaking equipment.
SemiAnalysis estimated in April that CXMT remained a year away from ramping any reasonable volume.
Chinese foundry Wuhan Xinxin Semiconductor Manufacturing is reportedly building a factory to produce HBM wafers. A report from SCMP said that Huawei Technologies had partnered with the firm in producing HBM chips, although the companies did not confirm the partnership.
Huawei has leaned on HBM stockpiles from suppliers like Samsung for use in their Ascend 910C AI processor, SemiAnalysis said in an April report, noting that while the chip was designed domestically, it still relies on foreign products obtained prior to or despite restrictions.
“Whether it be HBM from Samsung, wafers from TSMC, or equipment from America, Netherlands, and Japan, there is a big reliance on foreign industry,” SemiAnalysis said.