People

The devices that will transform the future are being designed in the middle of a pandemic

Chip designer Arm's Paul Williamson on what the company's new products will mean for the devices of tomorrow.

People using VR headsets

Arm's Paul Williamson says VR devices of the future are likely to come in a number of different form factors.

Photo: David Paul Morris/Bloomberg via Getty Images

The transformative devices of tomorrow are within Arm's reach.

Arm announced its latest slate of chip designs (the Cortex-A78 CPU, Mali-G78 GPU and Ethos-N78 NPU, for those keeping track) on Tuesday for products that will likely start hitting shelves in 2021 — assuming we're allowed outside by then. These designs, which SoftBank-owned Arm licenses to companies like Qualcomm, Samsung, Nvidia and Apple, power the processors and graphics cards found in mobile devices around the world, and increasingly new product categories, like VR headsets, 2-in-1 laptops and smart-home devices. They're all higher-power, more energy-efficient and more performant than the models they replace.

Arm's second-generation Ethos neural processing unit, offers a mobile processor dedicated to machine-learning tasks that's 25% more performant than last year's model, the company said. This might not sound like much, but Paul Williamson, Arm's VP and general manager of client devices, tells Protocol that it could provide the intelligence to efficiently power sensors in cutting-edge devices that help seamlessly blend the real and virtual worlds — and help out with battery life, too. "It's a very critical workload for things like VR and AR where you're trying to detect objects in the world around you," Wiliamson said. And given we're all stuck at home, immersive worlds to escape into sounds like a welcome distraction.

Protocol recently spoke with Williamson to discuss what these new chip designs could mean to the future of mobile devices, from new VR headsets to tomorrow's smart TVs, and designing the future during a pandemic.

This interview has been lightly edited for length and clarity.

Do you feel that these designs, especially this new NPU, have the power that existing VR and AR systems may be lacking? Are we getting to the point where devices are thin and efficient enough that people would actually use them for long stretches?

I think the shape of compute, to make it truly wearable, is going to require us to tether the headset for some time yet. I think you'll see a lighter-weight front end that's very much focused on driving the display and the sensors, but probably with a tethered compute engine supporting that. I think this platform of IP is really well structured to support a lot of innovation in that tethered structure, whether that's just by plugging into the smartphone or a dedicated puck [like Magic Leap has] that goes with a discrete product.

Oculus Quest has shown that people are getting more excited about VR. An untethered experience does offer some freedom, and this brings more power to those kinds of platforms, but it's a balance. I think for augmented applications, you'll still want an all-day wearable to be lighter than something like a Quest. And while this [NPU] drives efficiency and performance together — which means you can imagine that a Quest or a full VR headset gets lighter in terms of the needed battery for the same performance or it can drive more performance for the same weight — a physical display and a battery have some real weight to them. And those things aren't changing overnight. So, we're probably going to see a mixture of form factors.

Smart TVs are starting to feel ubiquitous. Are there other devices in the home that are going to be made smart at the same scale as our TVs?

I think it'll be interesting to see how we come out of the current pandemic in terms of our relationship with technology in the home: The smart assistant, whether it becomes a richer, more visual experience rather than just a voice interface to the cloud; whether we expect more videoconferencing in our lives more generally. There's definitely some interesting trends that this technology platform would certainly support if culturally we become more interested in having that capability. I think that's true of the workplace as well: We're going to become more interested in virtual presence in meetings and have more expectations around visual content there.

In [smart TVs], though, I think there's quite a long way to go. We're seeing interest in bringing more gaming capability, improvements in resolution even further to the 8K TVs announced at CES. Both the richness of the applications on digital TV and the performance demand of having 8K-type user interfaces and content means you absolutely need a stronger compute capability underneath.

It feels like we're getting to a point where my ostensibly mobile devices can do most of the tasks my desktop computer can do. How does Arm think about the convergence of these two markets that have been traditionally separate?

Actually I'm taking this call to you on the Microsoft Surface Pro X, which is an Arm-based Windows device, and it does cross that boundary of being something that I can pick up and use like a tablet, but also dock it with my large screen and use it like an enterprise device. It looks very at home running the full Office suite. And that's all powered on this Arm IP that we're describing here and allows you to build applications that are targeted for Arm, whether it's a smaller screen, a larger screen or a really big screen that you're plugged into.

So definitely we see that happening in real-world devices today, the Surface Pro X being a great example. And I think it's a trend that supports developers as well. If I want to address as many people as possible with something — like videoconferencing — I want to be able to do that across all form factors so they can do it from their garden, their living room or their office without having to think about these things. At Arm, we're definitely trying to make sure that we serve the developer, and multiple form factors, rather than thinking of this as a smartphone problem.

What do you make of the reports that Apple is looking at putting Arm chips in its laptops? Is that a further confluence of that trend?

We're not at liberty to speculate about what they might be doing, but I think the fusion between tablet, laptop and smartphone is clear and has developer benefit and it has user benefit. On the general theme, it's a positive step.

Are there things you're already seeing in the way that people are using existing products during the pandemic that are influencing the way that you think about tomorrow's products?

Our goal is to provide the compute platform that everybody needs for the future. So we've looked at this quite a bit and said, "What's changed?" I think what we've noted is that perhaps it's accelerated themes that we were already working on and fusing into the platform. We always have to work on quite a long timeframe — the IP that we're launching today was developed some time ago and it appears in silicon sometime next year in the hands of consumers. So we're typically looking at a three- to five-year timeline with our roadmap anyway. And I think some of the things that it accelerates is the need for performance across multiple different workloads. It's going to be a confluence of how all those bits perform together. That is a thing we see reinforced by some of the new ways people are using devices — wanting to run videoconferencing with multiple views open, at the same time as wanting to scroll through applications or have other things going on in their lives around them.

The other thing that I think this really validates is our focus on security. If we're going to use these devices increasingly for services like medical or personal data, making sure we've built a platform that can be as secure as possible for the developer and for the user is really key. So it's reinforced some of the investments we've been making for a while, and we'll expect them to have increasing demand in the future.

Policy

Musk’s texts reveal what tech’s most powerful people really want

From Jack Dorsey to Joe Rogan, Musk’s texts are chock-full of überpowerful people, bending a knee to Twitter’s once and (still maybe?) future king.

“Maybe Oprah would be interested in joining the Twitter board if my bid succeeds,” one text reads.

Photo illustration: Patrick Pleul/picture alliance via Getty Images; Protocol

Elon Musk’s text inbox is a rarefied space. It’s a place where tech’s wealthiest casually commit to spending billions of dollars with little more than a thumbs-up emoji and trade tips on how to rewrite the rules for how hundreds of millions of people around the world communicate.

Now, Musk’s ongoing legal battle with Twitter is giving the rest of us a fleeting glimpse into that world. The collection of Musk’s private texts that was made public this week is chock-full of tech power brokers. While the messages are meant to reveal something about Musk’s motivations — and they do — they also say a lot about how things get done and deals get made among some of the most powerful people in the world.

Keep Reading Show less
Issie Lapowsky

Issie Lapowsky ( @issielapowsky) is Protocol's chief correspondent, covering the intersection of technology, politics, and national affairs. She also oversees Protocol's fellowship program. Previously, she was a senior writer at Wired, where she covered the 2016 election and the Facebook beat in its aftermath. Prior to that, Issie worked as a staff writer for Inc. magazine, writing about small business and entrepreneurship. She has also worked as an on-air contributor for CBS News and taught a graduate-level course at New York University's Center for Publishing on how tech giants have affected publishing.

Sponsored Content

Great products are built on strong patents

Experts say robust intellectual property protection is essential to ensure the long-term R&D required to innovate and maintain America's technology leadership.

Every great tech product that you rely on each day, from the smartphone in your pocket to your music streaming service and navigational system in the car, shares one important thing: part of its innovative design is protected by intellectual property (IP) laws.

From 5G to artificial intelligence, IP protection offers a powerful incentive for researchers to create ground-breaking products, and governmental leaders say its protection is an essential part of maintaining US technology leadership. To quote Secretary of Commerce Gina Raimondo: "intellectual property protection is vital for American innovation and entrepreneurship.”

Keep Reading Show less
James Daly
James Daly has a deep knowledge of creating brand voice identity, including understanding various audiences and targeting messaging accordingly. He enjoys commissioning, editing, writing, and business development, particularly in launching new ventures and building passionate audiences. Daly has led teams large and small to multiple awards and quantifiable success through a strategy built on teamwork, passion, fact-checking, intelligence, analytics, and audience growth while meeting budget goals and production deadlines in fast-paced environments. Daly is the Editorial Director of 2030 Media and a contributor at Wired.
Fintech

Circle’s CEO: This is not the time to ‘go crazy’

Jeremy Allaire is leading the stablecoin powerhouse in a time of heightened regulation.

“It’s a complex environment. So every CEO and every board has to be a little bit cautious, because there’s a lot of uncertainty,” Circle CEO Jeremy Allaire told Protocol at Converge22.

Photo: Circle

Sitting solo on a San Francisco stage, Circle CEO Jeremy Allaire asked tennis superstar Serena Williams what it’s like to face “unrelenting skepticism.”

“What do you do when someone says you can’t do this?” Allaire asked the athlete turned VC, who was beaming into Circle’s Converge22 convention by video.

Keep Reading Show less
Benjamin Pimentel

Benjamin Pimentel ( @benpimentel) covers crypto and fintech from San Francisco. He has reported on many of the biggest tech stories over the past 20 years for the San Francisco Chronicle, Dow Jones MarketWatch and Business Insider, from the dot-com crash, the rise of cloud computing, social networking and AI to the impact of the Great Recession and the COVID crisis on Silicon Valley and beyond. He can be reached at bpimentel@protocol.com or via Google Voice at (925) 307-9342.

Enterprise

Is Salesforce still a growth company? Investors are skeptical

Salesforce is betting that customer data platform Genie and new Slack features can push the company to $50 billion in revenue by 2026. But investors are skeptical about the company’s ability to deliver.

Photo: Marlena Sloss/Bloomberg via Getty Images

Salesforce has long been enterprise tech’s golden child. The company said everything customers wanted to hear and did everything investors wanted to see: It produced robust, consistent growth from groundbreaking products combined with an aggressive M&A strategy and a cherished culture, all operating under the helm of a bombastic, but respected, CEO and team of well-coiffed executives.

Dreamforce is the embodiment of that success. Every year, alongside frustrating San Francisco residents, the over-the-top celebration serves as a battle cry to the enterprise software industry, reminding everyone that Marc Benioff’s mighty fiefdom is poised to expand even deeper into your corporate IT stack.

Keep Reading Show less
Joe Williams

Joe Williams is a writer-at-large at Protocol. He previously covered enterprise software for Protocol, Bloomberg and Business Insider. Joe can be reached at JoeWilliams@Protocol.com. To share information confidentially, he can also be contacted on a non-work device via Signal (+1-309-265-6120) or JPW53189@protonmail.com.

Policy

The US and EU are splitting on tech policy. That’s putting the web at risk.

A conversation with Cédric O, the former French minister of state for digital.

“With the difficulty of the U.S. in finding political agreement or political basis to legislate more, we are facing a risk of decoupling in the long term between the EU and the U.S.”

Photo: David Paul Morris/Bloomberg via Getty Images

Cédric O, France’s former minister of state for digital, has been an advocate of Europe’s approach to tech and at the forefront of the continent’s relations with U.S. giants. Protocol caught up with O last week at a conference in New York focusing on social media’s negative effects on society and the possibilities of blockchain-based protocols for alternative networks.

O said watching the U.S. lag in tech policy — even as some states pass their own measures and federal bills gain momentum — has made him worry about the EU and U.S. decoupling. While not as drastic as a disentangling of economic fortunes between the West and China, such a divergence, as O describes it, could still make it functionally impossible for companies to serve users on both sides of the Atlantic with the same product.

Keep Reading Show less
Ben Brody

Ben Brody (@ BenBrodyDC) is a senior reporter at Protocol focusing on how Congress, courts and agencies affect the online world we live in. He formerly covered tech policy and lobbying (including antitrust, Section 230 and privacy) at Bloomberg News, where he previously reported on the influence industry, government ethics and the 2016 presidential election. Before that, Ben covered business news at CNNMoney and AdAge, and all manner of stories in and around New York. He still loves appearing on the New York news radio he grew up with.

Latest Stories
Bulletins