AI's single point of failure | Rob Toews

Episode Summary

Title: AI's Single Point of Failure Paragraph 1: The Taiwan Semiconductor Manufacturing Company (TSMC) produces nearly all of the world's most advanced AI chips, including those from Nvidia, Google, AMD, and others. Modern artificial intelligence relies heavily on these specialized chips from TSMC. TSMC's chip fabrication facilities are located in Taiwan, just 110 miles from mainland China. A conflict between China and Taiwan could devastate the global AI ecosystem by disrupting production of these critical chips. Paragraph 2: TSMC has become the dominant player in advanced chip fabrication due to economies of scale and partnerships across the semiconductor supply chain. TSMC invests billions in expanding production capabilities, far outpacing competitors. This has made the world deeply dependent on chips from TSMC's facilities in Taiwan. Paragraph 3: Taiwan's importance in chip production is considered its "Silicon Shield" against Chinese aggression. However, analysts warn China could still invade Taiwan within 5 years. This would likely disrupt TSMC's production, cutting off the world's supply of advanced AI chips. Replicating TSMC's output would take competitors like Samsung years. Intel has also fallen behind TSMC in recent years. Paragraph 4: While existing AI chips would remain in use, losing the ability to produce the most advanced chips would profoundly disrupt AI progress. Diplomacy is needed to prevent a conflict that could devastate the AI ecosystem. TSMC's Taiwan facilities represent an alarming single point of failure.

Episode Show Notes

"The world's most important advanced technology is nearly all produced in a single facility," says AI expert Rob Toews. He describes how one company in Taiwan, TSMC, manufactures nearly all the most advanced semiconductor chips — a crucial technology that powers everything from phones to electric vehicles to next-generation artificial intelligence — and breaks down how geopolitical tensions in the region could paralyze the global field of AI.

Episode Transcript

SPEAKER_00: I'm Elise Hu. It's TED Talks Daily. You might not spend much time thinking about computer chip fabrication, but chips touch all of our daily lives and reach across the global supply chain. In his 2023 talk from TED AI, venture capitalist Rob Taives explains why the future of artificial intelligence is hanging in the balance because of chips and why we should care after the break. Support for TED Talks Daily comes from Capital One Bank. With no fees or minimums, banking with Capital One is the easiest decision in the history of decisions. Even easier than deciding to listen to another episode of your favorite podcast. And with no overdraft fees, is it even a decision? That's banking reimagined. What's in your wallet? Terms apply. See capitalone.com slash bank Capital One NA member FDIC. TED Talks Daily is brought to you by Progressive. Progressive helps you compare direct auto rates from a variety of companies so you can find a great one, even if it's not with them. Quote today at Progressive.com to find a rate that works with your budget. Progressive Casualty Insurance Company and affiliates. Comparison rates not available in all states or situations. SPEAKER_01: The following statement is utterly ludicrous. It is also true. The world's most important advanced technology is nearly all produced in a single facility. What's more, that facility is located in one of the most geopolitically fraught areas on earth. An area in which many analysts believe that war is inevitable within the decade. The future of artificial intelligence hangs in the balance. The Taiwan Semiconductor Manufacturing Company, or TSMC, makes all of the world's most advanced AI chips. This includes Nvidia's GPUs, Google's TPUs, AMD's GPUs, the AI chips from Microsoft, Amazon, Tesla, Cerebius, Samba Nova, and every other credible competitor. Modern artificial intelligence simply would not be possible without these highly specialized chips. Little wonder then that Time Magazine recently described TSMC as quote, the world's most important company that you've probably never heard of. Nvidia CEO Jensen Huang put it more colorfully saying quote, basically there is air and TSMC. TSMC's chip fabrication facilities, or fabs, the buildings where chips are physically built, is located on the western coast of Taiwan, a mere 110 miles from mainland China. Today, China and Taiwan are nearer to the brink of war than they have been in decades. Many policy makers in Washington predict that China will invade Taiwan within the next five years. A China-Taiwan conflict would be devastating for many reasons. Aside from the heavy human toll, one underappreciated consequence is that it would paralyze the global AI ecosystem. Put simply, the entire field of artificial intelligence faces an astonishingly precarious single point of failure in Taiwan. Amid all of the fervor around AI today, this fact is not widely enough appreciated. If you are working on or are interested in AI, you need to be paying attention. How did we get here and what can we do about it? Let's start with a brief whirlwind overview of the chip industry. Semiconductors, or chips, are the most complex object in the world that humanity knows how to mass produce. Making semiconductors requires the world's purest metals, the world's most expensive machinery, legions of highly specialized engineers, and atom-level manufacturing precision. It is important to distinguish between two different types of chip companies. First, fabless chip makers, which design but do not manufacture their own chips. And second, foundries, which manufacture chips designed by other companies. Almost every well-known chip company today is fabless, from NVIDIA to AMD to Qualcomm. These companies do not produce their own chips. Instead, they design chips and then they rely on foundries like TSMC to actually manufacture those chips for them. There are only three companies in the world today that are capable of manufacturing chips anywhere near the leading edge of semiconductor technology. TSMC, Samsung, and Intel. Of those three, only one can reliably produce the world's most advanced AI chips, including chips like NVIDIA's H100 GPUs. That one company is TSMC. As of this morning, TSMC's market capitalization was $470 billion, making it the 13th largest company in the world, larger than ExxonMobil, JPMorgan Chase, or Walmart. How has TSMC become such a dominant force? The short answer is that powerful economies of scale exist in the world of chip fabrication, leading inexorably to winner-take-all dynamics. Making advanced semiconductors requires tremendous upfront and ongoing capital expenditure. In 2021, TSMC announced that it would invest $100 billion over the next three years to continue expanding its fabrication capabilities. No other company in the world can justify that level of investment. TSMC can because of the sheer volume of chips that it produces, far more than any other company in the world. A related dynamic that helps explain TSMC's unassailable position is what has come to be known as the TSMC Grand Alliance. TSMC has invested heavily over decades to develop deep partnerships with dozens of companies across the semiconductor supply chain, from software providers like Cadence, to equipment manufacturers like ASML, to chip designers like NVIDIA. In turn, these companies have developed their own products in accordance with TSMC's roadmap, leading to powerful lock-in. In summary, a combination of economies of scale, network effects, and unrivaled specialization have made TSMC irreplaceable, and have made the entire world deeply, precariously dependent upon it. This brings us to the present delicate geopolitical moment. Last October, the Biden administration took the dramatic step of banning the export of all high-end AI chips to any entity in China. The rationale behind these measures was clear, to leverage US control of the global semiconductor supply chain as a choke point to handicap China's AI capabilities. The US government is currently formulating expansions to this policy. At the same time, the US is taking steps to reduce its reliance on chip fabrication facilities located in East Asia. In late 2022, TSMC announced that it would invest $40 billion to build two new state-of-the-art fabs in the United States, in Arizona. The first of these two fabs is slated to begin production in 2025. Bringing advanced chip production to US oil will help mitigate the AI industry's absolute dependence on Taiwan-based fabs. But the Arizona fabs will not solve everything. Their production capacity will be modest, representing less than 5% of TSMC's total global output. And the most advanced semiconductor production capabilities and technologies will remain in Taiwan. So, where might things go from here? Let's briefly consider a few possibilities on this three-dimensional chessboard. Let's start with the optimistic scenario. Taiwan's central role in the global semiconductor industry is often referred to as its Silicon Shield. The basic theory is this. Because China depends so heavily on Taiwan for the chips that it needs to keep its own economy running, China will stop short of invading Taiwan and putting TSMC's production at risk. And because the rest of the world is likewise so dependent on TSMC, the United States and other powers will go to great lengths to protect the island and defend its sovereignty. Under this theory, while China may continue to build out its military and engage in cross-strait saber rattling, it will stop short of kinetic action against Taiwan. But the Silicon Shield is just a theory, not a guarantee. What would happen if China were to move decisively to retake Taiwan? TSMC's fabs would almost certainly be rendered inoperative. It is conceivable that the Taiwanese or even the US military would preemptively destroy the fabs in order to prevent the CCP from taking control of this valuable strategic resource. Even if the physical buildings were to remain undamaged after a Chinese invasion, it is unrealistic that the CCP would be able to continue operating the fabs to produce cutting-edge chips. Keeping leading-edge fabs running requires ongoing deep partnership with organizations across the global semiconductor ecosystem, as well as a steady inflow of materials, equipment and services. These would be denied to an invading power. Let me say this one more time. If or when China invades Taiwan, TSMC's fabs will, in all likelihood, go offline. This will mean that no more Nvidia H100s or any other cutting-edge AI chips will be able to be produced anywhere in the world. What would this mean for the world of AI? After TSMC, the company best positioned to step up and produce cutting-edge AI chips is Samsung. Samsung is currently the only company in the world other than TSMC that is capable of producing 3nm chips, today's cutting-edge technology. But Samsung's production capabilities are far inferior to TSMC's today. In a best-case scenario, it would take Samsung years to scale up to TSMC's current AI chip yields and volumes. This brings us to America's former chip champion, Intel. It was hardly a decade ago that Intel's chip manufacturing capabilities were the envy of the world. But in recent years, Intel has fallen behind. The company struggled mightily in its transition to both 10nm and 7nm node technologies, even resorting to outsourcing some of its leading-edge production to TSMC. Under CEO Pat Gelsinger, Intel aspires to regain its chip-making supremacy, with an ambitious plan to leapfrog TSMC and begin producing 2nm chips in 2024. Whether this ambitious plan will actually prove achievable, however, remains to be seen. Before we despair too much, let us note a couple encouraging points. First, keep in mind that a considerable stock of AI chips already exists in the world, and even in a worst-case scenario, these chips would remain in use. Second, while the most advanced AI chips, like Google's TPUs or NVIDIA's H100s, can only be manufactured in Taiwan, there are many fabs around the world, from the US to Europe to Israel, that are capable of producing lagging-edge logic chips at scale. Though they are far less powerful than today's leading AI chips, these previous generation chips could be used in a pinch to support some AI computing workloads. Unfortunately, though, it would be devastating for humanity to lose its ability to produce the chips that power today's cutting-edge artificial intelligence. Progress in AI would be profoundly disrupted. Let us hope that diplomacy prevails.