Power

Microsoft just built one of the world’s most powerful supercomputers — in Azure

The device will crunch huge AI problems exclusively for OpenAI and is the latest sign of supercomputing facilities moving out of labs and onto the cloud.

Microsoft CEO Satya Nadella

Microsoft CEO Satya Nadella gives a keynote speech at a newly virtual Microsoft Build on Tuesday morning.

Photo: Courtesy of Microsoft

Microsoft has constructed a 285,000-processor supercomputer designed for machine learning applications as part of its Azure cloud infrastructure service. It should be one of the most powerful computers on the planet — and is the latest sign that supercomputing may slowly migrate to the cloud.

The supercomputer was developed for OpenAI, the organization working to build "safe artificial general intelligence," assuming such a thing is possible. It will be exclusively available to OpenAI as a cloud service for running the "massive distributed AI models" that it says will be needed to achieve artificial general intelligence, Microsoft announced Tuesday.

OpenAI has made some of the more notable AI advances in recent years, including building algorithms capable of powerful language processing and beating the world's best players at the video game Dota 2. But while mastering Dota 2 is difficult, it pales compared to building algorithms that understand the complexities of the real world, and OpenAI's plan is to use ever-greater data sets and computational power to make steps toward building an AGI.

OpenAI received a $1 billion investment from Microsoft last year, the bulk of which will be spent on computing power to achieve its goal. The terms of that deal require Microsoft to eventually become OpenAI's only source of computing.

The new machine, which Chief Technology Officer Kevin Scott called Microsoft's "first large-scale AI supercomputer," is the highlight of several announcements the company plans to make Tuesday during Microsoft Build, its annual developer conference. Held the last few years in downtown Seattle, Build, like many events, is being conducted entirely online this year and features a keynote address from CEO Satya Nadella on Tuesday morning.

The new system lives entirely within Azure, which is still subject to capacity constraints brought on by a surge of cloud computing activity caused by global stay-at-home orders during the COVID-19 pandemic. The new system for OpenAI was brought online in six months according to Scott — fast, given its claimed power, and curious, given that Microsoft could have really used that computing power to service existing customers.

Supercomputer rankings are taken very seriously among researchers and system builders, and Microsoft acknowledged that it has yet to submit the new Azure system to the Top500 organization, the official source of record on such matters. Still, with almost 300,000 CPUs, 10,000 GPUs and 400 Gbps of network connectivity to those GPUs, Microsoft estimates that its new system should rank fifth on the current list.

Artificial intelligence tools have been a key part of every cloud vendor's strategy over the last few years, in large part because artificial intelligence services require a lot of expensive computing power. This is a big step forward, but it's not clear whether Microsoft will allow other customers to access the supercomputer over time or whether it will be indefinitely reserved for OpenAI.

Given the size and unique requirements of supercomputers, most remain on-premises, managed by their owners. Cloud-based supercomputing is gaining steam, however; last year AWS devoted a significant portion of the opening keynote at its re:Invent conference to explain how it is building supercomputing capacity in its cloud, and Google has also talked up how high-performance computing customers can access supercomputing capacity in its cloud.

The new machine will be used to conduct "self-supervised learning," Scott said, taking very large datasets and training models for speech and image recognition that have the potential to produce outsized benefits compared to smaller datasets. "The bigger these models get, the more they can do," he said.

Other noteworthy announcements on the Build agenda this week include:

  • Azure Synapse Link, a new database service that lets customers combine transactional processing and analytical processing in Azure.
  • Microsoft Cloud for Healthcare, the company's "first industry-specific cloud offering" designed to help doctors and health care facilities provide better service and use advanced data analysis techniques.
  • A more customizable Microsoft Teams, which allows customers to tweak their company's Teams setup with a default set of applications, and also build and deploy Microsoft Teams applications from Visual Studio and Visual Studio Code, Microsoft's popular developer environments.
Sign up to the Protocol Cloud newsletter to receive a special edition this week focused on all the news coming out of Build.
Policy

Google is wooing a coalition of civil rights allies. It’s working.

The tech giant is adept at winning friends even when it’s not trying to immediately influence people.

A map display of Washington lines the floor next to the elevators at the Google office in Washington, D.C.

Photo: Andrew Harrer/Bloomberg via Getty Images

As Google has faced intensifying pressure from policymakers in recent years, it’s founded trade associations, hired a roster of former top government officials and sometimes spent more than $20 million annually on federal lobbying.

But the company has also become famous in Washington for nurturing less clearly mercenary ties. It has long funded the work of laissez-faire economists who now defend it against antitrust charges, for instance. It’s making inroads with traditional business associations that once pummeled it on policy, and also supports think tanks and advocacy groups.

Keep Reading Show less
Ben Brody

Ben Brody (@ BenBrodyDC) is a senior reporter at Protocol focusing on how Congress, courts and agencies affect the online world we live in. He formerly covered tech policy and lobbying (including antitrust, Section 230 and privacy) at Bloomberg News, where he previously reported on the influence industry, government ethics and the 2016 presidential election. Before that, Ben covered business news at CNNMoney and AdAge, and all manner of stories in and around New York. He still loves appearing on the New York news radio he grew up with.

Sustainability. It can be a charged word in the context of blockchain and crypto – whether from outsiders with a limited view of the technology or from insiders using it for competitive advantage. But as a CEO in the industry, I don’t think either of those approaches helps us move forward. We should all be able to agree that using less energy to get a task done is a good thing and that there is room for improvement in the amount of energy that is consumed to power different blockchain technologies.

So, what if we put the enormous industry talent and minds that have created and developed blockchain to the task of building in a more energy-efficient manner? Can we not just solve the issues but also set the standard for other industries to develop technology in a future-proof way?

Keep Reading Show less
Denelle Dixon, CEO of SDF

Denelle Dixon is CEO and Executive Director of the Stellar Development Foundation, a non-profit using blockchain to unlock economic potential by making money more fluid, markets more open, and people more empowered. Previously, Dixon served as COO of Mozilla. Leading the business, revenue and policy teams, she fought for Net Neutrality and consumer privacy protections and was responsible for commercial partnerships. Denelle also served as general counsel and legal advisor in private equity and technology.

Workplace

Everything you need to know about tech layoffs and hiring slowdowns

Will tech companies and startups continue to have layoffs?

It’s not just early-stage startups that are feeling the burn.

Photo: Kirsty O'Connor/PA Images via Getty Images

What goes up must come down.

High-flying startups with record valuations, huge hiring goals and ambitious expansion plans are now announcing hiring slowdowns, freezes and in some cases widespread layoffs. It’s the dot-com bust all over again — this time, without the cute sock puppet and in the midst of a global pandemic we just can’t seem to shake.

Keep Reading Show less
Nat Rubio-Licht

Nat Rubio-Licht is a Los Angeles-based news writer at Protocol. They graduated from Syracuse University with a degree in newspaper and online journalism in May 2020. Prior to joining the team, they worked at the Los Angeles Business Journal as a technology and aerospace reporter.

Entertainment

Sink into ‘Love, Death & Robots’ and more weekend recs

Don’t know what to do this weekend? We’ve got you covered.

Our favorite picks for your weekend pleasure.

Image: A24; 11 bit studios; Getty Images

We could all use a bit of a break. This weekend we’re diving into Netflix’s beautifully animated sci-fi “Love, Death & Robots,” losing ourselves in surreal “Men” and loving Zelda-like Moonlighter.

Keep Reading Show less
Nick Statt

Nick Statt is Protocol's video game reporter. Prior to joining Protocol, he was news editor at The Verge covering the gaming industry, mobile apps and antitrust out of San Francisco, in addition to managing coverage of Silicon Valley tech giants and startups. He now resides in Rochester, New York, home of the garbage plate and, completely coincidentally, the World Video Game Hall of Fame. He can be reached at nstatt@protocol.com.

Workplace

This machine would like to interview you for a job

Companies are embracing automated video interviews to filter through floods of job applicants. But interviews with a computer screen raise big ethical questions and might scare off candidates.

Although automated interview companies claim to reduce bias in hiring, the researchers and advocates who study AI bias are these companies’ most frequent critics.

Photo: Johner Images via Getty Images

Applying for a job these days is starting to feel a lot like online dating. Job-seekers send their resume into portal after portal and a silent abyss waits on the other side.

That abyss is silent for a reason and it has little to do with the still-tight job market or the quality of your particular resume. On the other side of the portal, hiring managers watch the hundreds and even thousands of resumes pile up. It’s an infinite mountain of digital profiles, most of them from people completely unqualified. Going through them all would be a virtually fruitless task.

Keep Reading Show less
Anna Kramer

Anna Kramer is a reporter at Protocol (Twitter: @ anna_c_kramer, email: akramer@protocol.com), where she writes about labor and workplace issues. Prior to joining the team, she covered tech and small business for the San Francisco Chronicle and privacy for Bloomberg Law. She is a recent graduate of Brown University, where she studied International Relations and Arabic and wrote her senior thesis about surveillance tools and technological development in the Middle East.

Latest Stories
Bulletins