Power

Nvidia's $40B bet on AI, edge computing and the data center of the future

With its purchase of chip designer Arm, Nvidia hopes to build on its recent success selling machine-learning chips for data centers and define the next decade of enterprise computing.

Nvidia's CEO Jensen Huang

"These types of computing platforms are going to start changing in shapes and sizes, although the architecture is going to be very similar," says Nvidia CEO Jensen Huang.

Photo: Patrick T. Fallon/Bloomberg via Getty Images

Nvidia's landmark purchase of chip design stalwart Arm will have an immediate impact on the mobile market, but the long-term payoff from the deal is likely to come from the enterprise.

The $40 billion deal, coming just four years after Softbank Group's 2016 acquisition of the U.K. chip designer, sets the stage for Nvidia's growing ambitions in enterprise computing. Nvidia rose to prominence building graphics chips for powerful gaming PCs, but in recent years has ridden a wave of interest in data center chips that can tackle complex machine learning algorithms to new heights.

Now Nvidia wants to play an even larger role in the data center. It now has the potential to design chips with a combination of server processing power and machine-learning aptitude that could set the stage for the next era of cloud computing. Emerging concepts like edge computing demand chips designed for difficult operating environments far from spacious data centers, and edge devices will also produce new, massive data sets that will require artificial intelligence technology to capture and analyze.

"These types of computing platforms are going to start changing in shapes and sizes, although the architecture is going to be very similar," said Nvidia CEO Jensen Huang on a conference call following the announcement of the deal. He was referring not just to data centers, but autonomous vehicles, robotics and high-performance computing applications that will require new types of chips designed for those unique situations.

If you own a smartphone, you almost certainly use a chip based around Arm's designs or its underlying technology. Arm doesn't actually make chips, but it designs and licenses core chip technology to other companies, like Apple, Qualcomm and Samsung, that add their own bells and whistles and contract with third-party manufacturers to produce processors for mobile phones.

With this acquisition, Nvidia is also betting that it can extend that model further into the data center. Arm's designs are known for their energy efficiency, which for years was not as prominent a concern inside the server farms that run the internet as compared to performance. But as the costs of operating cloud computing and in-house data centers have skyrocketed thanks to the energy and cooling systems required to operate millions of servers, companies are starting to think differently about the balance of price, performance and power consumption when making purchasing decisions.

It has taken a long time for Arm server chips to achieve performance parity with those designed and built by Intel, which is just one of the reasons why Intel currently enjoys more than 90% market share in the data center. That market stake generated $38.4 billion in revenue in 2019, and that's a big target for its rivals.

However, 2019 was also the first year during which cloud giant AWS started allowing customers to rent computing power running on a custom server processor designed around Arm's technology. A second-generation chip introduced earlier this year offers a "40% improvement on cost/performance ratio" compared to Intel chips available through AWS, according to the cloud provider.

Should AWS prove real demand for Arm server processors exists in the cloud, Microsoft and Google — both of which have chip design expertise in house — are likely to follow suit. Intel's well-documented challenges advancing its chipmaking technology have also opened the door for rivals with alternative products.

Over the long term, however, the marriage of Nvidia's AI technology and Arm's processing expertise is the real key to the deal. This is also one of the major concerns about the deal, that Nvidia's corporate interests will cast a shadow over Arm's road map, bending it toward designs that advance Nvidia's strategy at the expense of Arm's current third-party licensees.

"Every 15 years, the computer industry goes through a strategic inflection point, or as Jefferies U.S. semiconductors analyst Mark Lipacis calls it, a tectonic shift, that dramatically transforms the computing model and realigns the leadership of the industry," wrote Sparq Capital's Michael Bruck, a former Intel executive, in post earlier this month on Venturebeat discussing the potential Nvidia-Arm deal.

The last 15 years have been dominated by the rise of smartphones and cloud computing as the two main forces in modern computing, best exemplified by Apple's Arm-powered iPhone and AWS' Intel-powered cloud operation. Nvidia's $40 billion gamble assumes that the next 15 years will require both edge computing devices and massive data centers to add specialized machine-learning chips to serve new applications such as self-driving cars, which won't be able to tolerate processing delays caused by underpowered chips or round trips to far-flung data centers.

"In time, there will be trillions of these small autonomous computers, powered by AI, connected to massively powerful cloud data centers in every corner of the world," Huang said. If Nvidia can bypass the concerns of the U.K. tech industry and pull off this deal without alienating the massive ecosystem of Arm partners, it will be the chip company for that era.

Enterprise

How I decided to leave the US and pursue a tech career in Europe

Melissa Di Donato moved to Europe to broaden her technology experience with a different market perspective. She planned to stay two years. Seventeen years later, she remains in London as CEO of Suse.

“It was a hard go for me in the beginning. I was entering inside of a company that had been very traditional in a sense.”

Photo: Suse

Click banner image for more How I decided seriesA native New Yorker, Melissa Di Donato made a life-changing decision back in 2005 when she packed up for Europe to further her career in technology. Then with IBM, she made London her new home base.

Today, Di Donato is CEO of Germany’s Suse, now a 30-year-old, open-source enterprise software company that specializes in Linux operating systems, container management, storage, and edge computing. As the company’s first female leader, she has led Suse through the coronavirus pandemic, a 2021 IPO on the Frankfurt Stock Exchange, and the acquisitions of Kubernetes management startup Rancher Labs and container security company NeuVector.

Keep Reading Show less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Sponsored Content

Great products are built on strong patents

Experts say robust intellectual property protection is essential to ensure the long-term R&D required to innovate and maintain America's technology leadership.

Every great tech product that you rely on each day, from the smartphone in your pocket to your music streaming service and navigational system in the car, shares one important thing: part of its innovative design is protected by intellectual property (IP) laws.

From 5G to artificial intelligence, IP protection offers a powerful incentive for researchers to create ground-breaking products, and governmental leaders say its protection is an essential part of maintaining US technology leadership. To quote Secretary of Commerce Gina Raimondo: "intellectual property protection is vital for American innovation and entrepreneurship.”

Keep Reading Show less
James Daly
James Daly has a deep knowledge of creating brand voice identity, including understanding various audiences and targeting messaging accordingly. He enjoys commissioning, editing, writing, and business development, particularly in launching new ventures and building passionate audiences. Daly has led teams large and small to multiple awards and quantifiable success through a strategy built on teamwork, passion, fact-checking, intelligence, analytics, and audience growth while meeting budget goals and production deadlines in fast-paced environments. Daly is the Editorial Director of 2030 Media and a contributor at Wired.
Enterprise

UiPath had a rocky few years. Rob Enslin wants to turn it around.

Protocol caught up with Enslin, named earlier this year as UiPath’s co-CEO, to discuss why he left Google Cloud, the untapped potential of robotic-process automation, and how he plans to lead alongside founder Daniel Dines.

Rob Enslin, UiPath's co-CEO, chats with Protocol about the company's future.

Photo: UiPath

UiPath has had a shaky history.

The company, which helps companies automate business processes, went public in 2021 at a valuation of more than $30 billion, but now the company’s market capitalization is only around $7 billion. To add insult to injury, UiPath laid off 5% of its staff in June and then lowered its full-year guidance for fiscal year 2023 just months later, tanking its stock by 15%.

Keep Reading Show less
Aisha Counts

Aisha Counts (@aishacounts) is a reporter at Protocol covering enterprise software. Formerly, she was a management consultant for EY. She's based in Los Angeles and can be reached at acounts@protocol.com.

Workplace

Figma CPO: We can do more with Adobe

Yuhki Yamashita thinks Figma might tackle video or 3D objects someday.

Figman CPO Yuhki Yamashita told Protocol about Adobe's acquisition of the company.

Photo: Figma

Figma CPO Yuhki Yamashita’s first design gig was at The Harvard Crimson, waiting for writers to file their stories so he could lay them out in Adobe InDesign. Given his interest in computer science, pursuing UX design became the clear move. He worked on Outlook at Microsoft, YouTube at Google, and user experience at Uber, where he was a very early user of Figma. In 2019, he became a VP of product at Figma; this past June, he became CPO.

“Design has been really near and dear to my heart, which is why when this opportunity came along to join Figma and rethink design, it was such an obvious opportunity,” Yamashita said.

Keep Reading Show less
Lizzy Lawrence

Lizzy Lawrence ( @LizzyLaw_) is a reporter at Protocol, covering tools and productivity in the workplace. She's a recent graduate of the University of Michigan, where she studied sociology and international studies. She served as editor in chief of The Michigan Daily, her school's independent newspaper. She's based in D.C., and can be reached at llawrence@protocol.com.

Climate

Microsoft lays out its climate advocacy goals

The tech giant has staked out exactly what kind of policies it will support to decarbonize the world and clean up the grid.

Microsoft published two briefs explaining what new climate policies it will advocate for.

Photo by Jeremy Bezanger on Unsplash

The tech industry has no shortage of climate goals, but they’ll be very hard to achieve without the help of sound public policy.

Microsoft published two new briefs on Sept. 22 explaining what policies it will advocate for in the realm of reducing carbon and cleaning up the grid. With policymakers in the U.S. and around the world beginning to weigh more stringent climate policies (or in the U.S.’s case, any serious climate policies at all), the briefs will offer a measuring stick for whether Microsoft is living up to its ideals.

Keep Reading Show less
Brian Kahn

Brian ( @blkahn) is Protocol's climate editor. Previously, he was the managing editor and founding senior writer at Earther, Gizmodo's climate site, where he covered everything from the weather to Big Oil's influence on politics. He also reported for Climate Central and the Wall Street Journal. In the even more distant past, he led sleigh rides to visit a herd of 7,000 elk and boat tours on the deepest lake in the U.S.

Latest Stories
Bulletins