I.T. News – Nov 13, 2024

1 - The U.S. leads on chips, but China has an underrated advantage in the race to adopt AI

Grace Shao. Fortune.

Grace Shao is founder of Proem, a strategic communications consultancy focused on helping tech and AI companies on their global expansion strategy.

Who will win the AI arms race? The U.S. is clearly miles ahead of China when it comes to the sophistication of its chips. But an Nvidia processor is only part of what’s needed to adopt AI.

AI relies on real-world infrastructure: servers, data centers and stable power. That needs energy, land, and other resources, not just GPUs.

And that can be very costly. About a month ago, a consortium of investors including Microsoft and BlackRock pledged to mobilize as much as $100 billion to build data centers in the U.S. and partner countries. “The capital spending needed for AI infrastructure and the new energy to power it goes beyond what any single company or government can finance,” Microsoft president Brad Smith explained at the time.

The U.S. will need an incalculable amount of time to build up its physical infrastructure in an economy with more expensive land, labor and power. U.S. democracy also has several bottlenecks and veto points—like local legislation, regulations, and community hearings—that will delay, if not outright halt, new data center construction. And that may mean a huge advantage for China and its state-driven “command economy.”

The media and investors tend to focus on computing power, and thus miss much of the real-world work that supports AI. Beijing’s industrial policy and its ability to funnel public and private resources into growing sectors swiftly will make the country a major power in the world of AI, much like it already has proved to be in clean energy and electric vehicles.

Being at the leading edge of a new technology means little if a country can’t figure out how to make it work at scale.

Expensive infrastructure investments today are needed to support tomorrow’s AI demand. Meta CEO Mark Zuckerberg recognizes this: In Meta’s most recent earnings call, Zuckerberg defended heavy investments in data centers by arguing the risk of underinvestment, and missing out on “the most critical technology for the next decade and a half” was far greater.

“I’d rather risk building capacity before it is needed, rather than too late, given the long lead times for spinning up new infra projects,” he told analysts.

The long lead time isn’t due to bottlenecks at Nvidia, but instead something far more mundane. The lead time on new power transformers and generators, needed to power the increased electricity demands from data centers, can be as long as 4 years. Even if the power equipment is in place, data center operators still need to wait for them to be connected to the grid. Local zoning laws and land permits would also take time, often months or years for approval.

Northern Virginia currently has the U.S.’s highest concentration of data centers. According to local power utility Dominion Energy, any data center that consume over 100 megawatts of power will now need to wait as much as three additional years, on top of the current 3 to 4 years wait, to get connected to the grid.

Big tech firms thus need to spend big on infrastructure today long before they can enjoy a meaningful return on their investments. And if they don’t invest now, they risk falling behind their competitors in the future, or worse, not being able to provide the raw power needed to run faster and more powerful algorithms when the technology advances further.

China may be able to ramp up its AI infrastructure faster and more cheaply than the U.S. can. That may not be enough to overcome China’s weakness in producing advanced chips. But if and when China does figure out how to make powerful semiconductors, it can catch up quickly to the U.S., if not potentially overtake it.

China’s state-driven system can put resources and energy into infrastructure at a speed and scale