People

The devices that will transform the future are being designed in the middle of a pandemic

Chip designer Arm's Paul Williamson on what the company's new products will mean for the devices of tomorrow.

People using VR headsets

Arm's Paul Williamson says VR devices of the future are likely to come in a number of different form factors.

Photo: David Paul Morris/Bloomberg via Getty Images

The transformative devices of tomorrow are within Arm's reach.

Arm announced its latest slate of chip designs (the Cortex-A78 CPU, Mali-G78 GPU and Ethos-N78 NPU, for those keeping track) on Tuesday for products that will likely start hitting shelves in 2021 — assuming we're allowed outside by then. These designs, which SoftBank-owned Arm licenses to companies like Qualcomm, Samsung, Nvidia and Apple, power the processors and graphics cards found in mobile devices around the world, and increasingly new product categories, like VR headsets, 2-in-1 laptops and smart-home devices. They're all higher-power, more energy-efficient and more performant than the models they replace.

Arm's second-generation Ethos neural processing unit, offers a mobile processor dedicated to machine-learning tasks that's 25% more performant than last year's model, the company said. This might not sound like much, but Paul Williamson, Arm's VP and general manager of client devices, tells Protocol that it could provide the intelligence to efficiently power sensors in cutting-edge devices that help seamlessly blend the real and virtual worlds — and help out with battery life, too. "It's a very critical workload for things like VR and AR where you're trying to detect objects in the world around you," Wiliamson said. And given we're all stuck at home, immersive worlds to escape into sounds like a welcome distraction.

Protocol recently spoke with Williamson to discuss what these new chip designs could mean to the future of mobile devices, from new VR headsets to tomorrow's smart TVs, and designing the future during a pandemic.

This interview has been lightly edited for length and clarity.

Do you feel that these designs, especially this new NPU, have the power that existing VR and AR systems may be lacking? Are we getting to the point where devices are thin and efficient enough that people would actually use them for long stretches?

I think the shape of compute, to make it truly wearable, is going to require us to tether the headset for some time yet. I think you'll see a lighter-weight front end that's very much focused on driving the display and the sensors, but probably with a tethered compute engine supporting that. I think this platform of IP is really well structured to support a lot of innovation in that tethered structure, whether that's just by plugging into the smartphone or a dedicated puck [like Magic Leap has] that goes with a discrete product.

Oculus Quest has shown that people are getting more excited about VR. An untethered experience does offer some freedom, and this brings more power to those kinds of platforms, but it's a balance. I think for augmented applications, you'll still want an all-day wearable to be lighter than something like a Quest. And while this [NPU] drives efficiency and performance together — which means you can imagine that a Quest or a full VR headset gets lighter in terms of the needed battery for the same performance or it can drive more performance for the same weight — a physical display and a battery have some real weight to them. And those things aren't changing overnight. So, we're probably going to see a mixture of form factors.

Smart TVs are starting to feel ubiquitous. Are there other devices in the home that are going to be made smart at the same scale as our TVs?

I think it'll be interesting to see how we come out of the current pandemic in terms of our relationship with technology in the home: The smart assistant, whether it becomes a richer, more visual experience rather than just a voice interface to the cloud; whether we expect more videoconferencing in our lives more generally. There's definitely some interesting trends that this technology platform would certainly support if culturally we become more interested in having that capability. I think that's true of the workplace as well: We're going to become more interested in virtual presence in meetings and have more expectations around visual content there.

In [smart TVs], though, I think there's quite a long way to go. We're seeing interest in bringing more gaming capability, improvements in resolution even further to the 8K TVs announced at CES. Both the richness of the applications on digital TV and the performance demand of having 8K-type user interfaces and content means you absolutely need a stronger compute capability underneath.

It feels like we're getting to a point where my ostensibly mobile devices can do most of the tasks my desktop computer can do. How does Arm think about the convergence of these two markets that have been traditionally separate?

Actually I'm taking this call to you on the Microsoft Surface Pro X, which is an Arm-based Windows device, and it does cross that boundary of being something that I can pick up and use like a tablet, but also dock it with my large screen and use it like an enterprise device. It looks very at home running the full Office suite. And that's all powered on this Arm IP that we're describing here and allows you to build applications that are targeted for Arm, whether it's a smaller screen, a larger screen or a really big screen that you're plugged into.

So definitely we see that happening in real-world devices today, the Surface Pro X being a great example. And I think it's a trend that supports developers as well. If I want to address as many people as possible with something — like videoconferencing — I want to be able to do that across all form factors so they can do it from their garden, their living room or their office without having to think about these things. At Arm, we're definitely trying to make sure that we serve the developer, and multiple form factors, rather than thinking of this as a smartphone problem.

What do you make of the reports that Apple is looking at putting Arm chips in its laptops? Is that a further confluence of that trend?

We're not at liberty to speculate about what they might be doing, but I think the fusion between tablet, laptop and smartphone is clear and has developer benefit and it has user benefit. On the general theme, it's a positive step.

Are there things you're already seeing in the way that people are using existing products during the pandemic that are influencing the way that you think about tomorrow's products?

Our goal is to provide the compute platform that everybody needs for the future. So we've looked at this quite a bit and said, "What's changed?" I think what we've noted is that perhaps it's accelerated themes that we were already working on and fusing into the platform. We always have to work on quite a long timeframe — the IP that we're launching today was developed some time ago and it appears in silicon sometime next year in the hands of consumers. So we're typically looking at a three- to five-year timeline with our roadmap anyway. And I think some of the things that it accelerates is the need for performance across multiple different workloads. It's going to be a confluence of how all those bits perform together. That is a thing we see reinforced by some of the new ways people are using devices — wanting to run videoconferencing with multiple views open, at the same time as wanting to scroll through applications or have other things going on in their lives around them.

The other thing that I think this really validates is our focus on security. If we're going to use these devices increasingly for services like medical or personal data, making sure we've built a platform that can be as secure as possible for the developer and for the user is really key. So it's reinforced some of the investments we've been making for a while, and we'll expect them to have increasing demand in the future.

Protocol | Policy

5 things to know about FCC nominee Gigi Sohn

The veteran of some of the earliest tech policy fights is a longtime consumer champion and net-neutrality advocate.

Gigi Sohn, who President Joe Biden nominated to serve on the FCC, is a longtime net-neutrality advocate.

Photo: Alex Wong/Getty Images

President Joe Biden on Tuesday nominated Gigi Sohn to serve as a Federal Communications Commissioner, teeing up a Democratic majority at the agency that oversees broadband issues after months of delay.

Like Lina Khan, who Biden picked in June to head up the Federal Trade Commission, Sohn is a progressive favorite. And if confirmed, she'll take up a position in an agency trying to pull policy levers on net neutrality, privacy and broadband access even as Congress is stalled.

Keep Reading Show less
Ben Brody

Ben Brody (@ BenBrodyDC) is a senior reporter at Protocol focusing on how Congress, courts and agencies affect the online world we live in. He formerly covered tech policy and lobbying (including antitrust, Section 230 and privacy) at Bloomberg News, where he previously reported on the influence industry, government ethics and the 2016 presidential election. Before that, Ben covered business news at CNNMoney and AdAge, and all manner of stories in and around New York. He still loves appearing on the New York news radio he grew up with.

If you've ever tried to pick up a new fitness routine like running, chances are you may have fallen into the "motivation vs. habit" trap once or twice. You go for a run when the sun is shining, only to quickly fall off the wagon when the weather turns sour.

Similarly, for many businesses, 2020 acted as the storm cloud that disrupted their plans for innovation. With leaders busy grappling with the pandemic, innovation frequently got pushed to the backburner. In fact, according to McKinsey, the majority of organizations shifted their focus mainly to maintaining business continuity throughout the pandemic.

Keep Reading Show less
Gaurav Kataria
Group Product Manager, Trello at Atlassian
Protocol | Workplace

Adobe wants a more authentic NFT world

Adobe's Content Credentials feature will allow Creative Cloud subscribers to attach edit-tracking information to Photoshop files. The goal is to create a more trustworthy NFT market and digital landscape.

Adobe's Content Credentials will allow users to attach their identities to an image

Image: Adobe

Remember the viral, fake photo of Kurt Cobain and Biggie Smalls that duped and delighted the internet in 2017? Doctored images manipulate people and erode trust and we're not great at spotting them. The entire point of the emerging NFT art market is to create valuable and scarce digital files and when there isn't an easy way to check for an image's origin and edits, there's a problem. What if someone steals an NFT creator's image and pawns it off as their own? As a hub for all kinds of multimedia, Adobe feels a responsibility to combat misinformation and provide a safe space for NFT creators. That's why it's rolling out Content Credentials, a record that can be attached to a Photoshop file of a creator's identity and includes any edits they made.

Users can connect their social media addresses and crypto wallet addresses to images in Photoshop. This further proves the image creator's identity, but it's also helpful in determining the creators of NFTs. Adobe has partnered with NFT marketplaces KnownOrigin, OpenSea, Rarible and SuperRare in this effort. "Today there's not a way to know that the NFT you're buying was actually created by a true creator," said Adobe General Counsel Dana Rao. "We're allowing the creator to show their identity and attach it to the image."

Keep Reading Show less
Lizzy Lawrence

Lizzy Lawrence ( @LizzyLaw_) is a reporter at Protocol, covering tools and productivity in the workplace. She's a recent graduate of the University of Michigan, where she studied sociology and international studies. She served as editor in chief of The Michigan Daily, her school's independent newspaper. She's based in D.C., and can be reached at llawrence@protocol.com.

Protocol | China

Why another Chinese lesbian dating app just shut down

With neither political support nor a profitable business model, lesbian dating apps are finding it hard to survive in China.

Operating a dating app for LGBTQ+ communities in China is like walking a tightrope.

Photo: Nicolas Asfouri/AFP via Getty Images

When Lesdo, a Chinese dating app designed for lesbian women, announced it was closing down, it didn't come as a surprise to the LGBTQ+ community.

It's unclear what directly caused this decision. 2021 hasn't been kind to China's queer communities; WeChat has deactivated queer groups' public accounts and Beijing has pressured charity organizations not to work with queer activists.

Keep Reading Show less
Zeyi Yang
Zeyi Yang is a reporter with Protocol | China. Previously, he worked as a reporting fellow for the digital magazine Rest of World, covering the intersection of technology and culture in China and neighboring countries. He has also contributed to the South China Morning Post, Nikkei Asia, Columbia Journalism Review, among other publications. In his spare time, Zeyi co-founded a Mandarin podcast that tells LGBTQ stories in China. He has been playing Pokemon for 14 years and has a weird favorite pick.

The Oura Ring was a sleep-tracking hit. Can the next one be even more?

Oura wants to be a media company, an activity tracker and even a way to know you're sick before you feel sick.

Over the last few years, the Oura Ring has become one of the most recognizable wearables this side of the Apple Watch.

Photo: Oura

Oura CEO Harpreet Rai swears he didn't know Kim Kardashian was a fan. He was as surprised as anyone when she started posting screenshots from the Oura app to her Instagram story, and got into a sleep battle with fellow Oura user Gwyneth Paltrow. Or when Jennifer Aniston revealed that Jimmy Kimmel got her hooked on Oura … and how her ring fell off in a salad. "I am addicted to it," Aniston said, "and it's ruining my life" by shaming her about her lack of sleep. "I think we're definitely seeing traction outside of tech," Rai said. "Which is cool."

Over the last couple of years, Oura's ring (imaginatively named the Oura Ring) has become one of the most recognizable wearables this side of the Apple Watch. The company started with a Kickstarter campaign in 2015, but really started to find traction with its second-generation model in 2018. It's not exactly a mainstream device — Oura said it has sold more than 500,000 rings, up from 150,000 in March 2020 but still not exactly Apple Watch levels — but it has reached some of the most successful, influential and probably sleep-deprived people in the industry. Jack Dorsey is a professed fan, as is Marc Benioff.

Keep Reading Show less
David Pierce

David Pierce ( @pierce) is Protocol's editorial director. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.

Latest Stories