Source Code: Your daily look at what matters in tech.

source-codesource codeauthorMike MurphyNoneWant your finger on the pulse of everything that's happening in tech? Sign up to get David Pierce's daily newsletter.64fd3cbe9f
×

Get access to Protocol

Will be used in accordance with our Privacy Policy

I’m already a subscriber
People

The devices that will transform the future are being designed in the middle of a pandemic

Chip designer Arm's Paul Williamson on what the company's new products will mean for the devices of tomorrow.

People using VR headsets

Arm's Paul Williamson says VR devices of the future are likely to come in a number of different form factors.

Photo: David Paul Morris/Bloomberg via Getty Images

The transformative devices of tomorrow are within Arm's reach.

Arm announced its latest slate of chip designs (the Cortex-A78 CPU, Mali-G78 GPU and Ethos-N78 NPU, for those keeping track) on Tuesday for products that will likely start hitting shelves in 2021 — assuming we're allowed outside by then. These designs, which SoftBank-owned Arm licenses to companies like Qualcomm, Samsung, Nvidia and Apple, power the processors and graphics cards found in mobile devices around the world, and increasingly new product categories, like VR headsets, 2-in-1 laptops and smart-home devices. They're all higher-power, more energy-efficient and more performant than the models they replace.

Arm's second-generation Ethos neural processing unit, offers a mobile processor dedicated to machine-learning tasks that's 25% more performant than last year's model, the company said. This might not sound like much, but Paul Williamson, Arm's VP and general manager of client devices, tells Protocol that it could provide the intelligence to efficiently power sensors in cutting-edge devices that help seamlessly blend the real and virtual worlds — and help out with battery life, too. "It's a very critical workload for things like VR and AR where you're trying to detect objects in the world around you," Wiliamson said. And given we're all stuck at home, immersive worlds to escape into sounds like a welcome distraction.

Protocol recently spoke with Williamson to discuss what these new chip designs could mean to the future of mobile devices, from new VR headsets to tomorrow's smart TVs, and designing the future during a pandemic.

This interview has been lightly edited for length and clarity.

Do you feel that these designs, especially this new NPU, have the power that existing VR and AR systems may be lacking? Are we getting to the point where devices are thin and efficient enough that people would actually use them for long stretches?

I think the shape of compute, to make it truly wearable, is going to require us to tether the headset for some time yet. I think you'll see a lighter-weight front end that's very much focused on driving the display and the sensors, but probably with a tethered compute engine supporting that. I think this platform of IP is really well structured to support a lot of innovation in that tethered structure, whether that's just by plugging into the smartphone or a dedicated puck [like Magic Leap has] that goes with a discrete product.

Oculus Quest has shown that people are getting more excited about VR. An untethered experience does offer some freedom, and this brings more power to those kinds of platforms, but it's a balance. I think for augmented applications, you'll still want an all-day wearable to be lighter than something like a Quest. And while this [NPU] drives efficiency and performance together — which means you can imagine that a Quest or a full VR headset gets lighter in terms of the needed battery for the same performance or it can drive more performance for the same weight — a physical display and a battery have some real weight to them. And those things aren't changing overnight. So, we're probably going to see a mixture of form factors.

Smart TVs are starting to feel ubiquitous. Are there other devices in the home that are going to be made smart at the same scale as our TVs?

I think it'll be interesting to see how we come out of the current pandemic in terms of our relationship with technology in the home: The smart assistant, whether it becomes a richer, more visual experience rather than just a voice interface to the cloud; whether we expect more videoconferencing in our lives more generally. There's definitely some interesting trends that this technology platform would certainly support if culturally we become more interested in having that capability. I think that's true of the workplace as well: We're going to become more interested in virtual presence in meetings and have more expectations around visual content there.

In [smart TVs], though, I think there's quite a long way to go. We're seeing interest in bringing more gaming capability, improvements in resolution even further to the 8K TVs announced at CES. Both the richness of the applications on digital TV and the performance demand of having 8K-type user interfaces and content means you absolutely need a stronger compute capability underneath.

It feels like we're getting to a point where my ostensibly mobile devices can do most of the tasks my desktop computer can do. How does Arm think about the convergence of these two markets that have been traditionally separate?

Actually I'm taking this call to you on the Microsoft Surface Pro X, which is an Arm-based Windows device, and it does cross that boundary of being something that I can pick up and use like a tablet, but also dock it with my large screen and use it like an enterprise device. It looks very at home running the full Office suite. And that's all powered on this Arm IP that we're describing here and allows you to build applications that are targeted for Arm, whether it's a smaller screen, a larger screen or a really big screen that you're plugged into.

So definitely we see that happening in real-world devices today, the Surface Pro X being a great example. And I think it's a trend that supports developers as well. If I want to address as many people as possible with something — like videoconferencing — I want to be able to do that across all form factors so they can do it from their garden, their living room or their office without having to think about these things. At Arm, we're definitely trying to make sure that we serve the developer, and multiple form factors, rather than thinking of this as a smartphone problem.

What do you make of the reports that Apple is looking at putting Arm chips in its laptops? Is that a further confluence of that trend?

We're not at liberty to speculate about what they might be doing, but I think the fusion between tablet, laptop and smartphone is clear and has developer benefit and it has user benefit. On the general theme, it's a positive step.

Are there things you're already seeing in the way that people are using existing products during the pandemic that are influencing the way that you think about tomorrow's products?

Our goal is to provide the compute platform that everybody needs for the future. So we've looked at this quite a bit and said, "What's changed?" I think what we've noted is that perhaps it's accelerated themes that we were already working on and fusing into the platform. We always have to work on quite a long timeframe — the IP that we're launching today was developed some time ago and it appears in silicon sometime next year in the hands of consumers. So we're typically looking at a three- to five-year timeline with our roadmap anyway. And I think some of the things that it accelerates is the need for performance across multiple different workloads. It's going to be a confluence of how all those bits perform together. That is a thing we see reinforced by some of the new ways people are using devices — wanting to run videoconferencing with multiple views open, at the same time as wanting to scroll through applications or have other things going on in their lives around them.

The other thing that I think this really validates is our focus on security. If we're going to use these devices increasingly for services like medical or personal data, making sure we've built a platform that can be as secure as possible for the developer and for the user is really key. So it's reinforced some of the investments we've been making for a while, and we'll expect them to have increasing demand in the future.

Protocol | Enterprise

Alphabet goes deep into industrial robotic software with Intrinsic

If it succeeds, the gambit could help support Google Cloud's lofty ambitions in the manufacturing sector.

Alphabet is aiming to make advanced robotic technology affordable to customers.

Photo: Getty Images

Alphabet launched a new division Friday called Intrinsic, which will focus on building software for industrial robots, per a blog post. The move plunges the tech giant deeper into a sector that's in the midst of a major wave of digitization.

The goal of Intrinsic is to "give industrial robots the ability to sense, learn, and automatically make adjustments as they're completing tasks, so they work in a wider range of settings and applications," CEO Wendy Tan-White wrote in the post.

Keep Reading Show less
Joe Williams

Joe Williams is a senior reporter at Protocol covering enterprise software, including industry giants like Salesforce, Microsoft, IBM and Oracle. He previously covered emerging technology for Business Insider. Joe can be reached at JWilliams@Protocol.com. To share information confidentially, he can also be contacted on a non-work device via Signal (+1-309-265-6120) or JPW53189@protonmail.com.

As President of Alibaba Group, I am often asked, "What is Alibaba doing in the U.S.?"

In fact, most people are not aware we have a business in the U.S. because we are not a U.S. consumer-facing service that people use every day – nor do we want to be. Our consumers – nearly 900 million of them – are located in China.

Keep Reading Show less
J. Michael Evans
Michael Evans leads and executes Alibaba Group's international strategy for globalizing the company and expanding its businesses outside of China.
People

To combat disinformation, centralize moderation

There's more to content moderation than deplatforming.

In addition to interplatform collaboration, big tech companies would also benefit from greater collaborations with academic researchers, government agencies or other private entities, the authors argue.

Image: Twitter

Yonatan Lupu is an associate professor of political science and international affairs at George Washington University. Nicolás Velasquez Hernandez is a lecturer at the Elliott School of International Affairs and a postdoctoral researcher at GW's Institute for Data, Democracy and Politics.

Florida Gov. Ron DeSantis' signing of a bill that penalizes social media companies for deplatforming politicians was yet another salvo in an escalating struggle over the growth and spread of digital disinformation, malicious content and extremist ideology. While Big Tech, world leaders and policymakers — along with many of us in the research community — all recognize the importance of mitigating online and offline harm, agreement on how best to do that is few and far between.

Keep Reading Show less
Protocol | Fintech

Marqeta turns to a fintech outsider

Randy Kern, a Salesforce and Microsoft veteran, is taking a plunge into the payments world.

Randy Kern is joining Marqeta after decades at Microsoft and Salesforce.

Photo: Marqeta

Marqeta has just named a new chief technology officer. And it's an eyebrow-raising choice for a critical post as the payments powerhouse faces new challenges as a public company.

Randy Kern, who joined Marqeta last month, is a tech veteran with decades of engineering and leadership experience, mainly in enterprise software. He worked on Microsoft's Azure and Bing technologies, and then went on to Salesforce where he last served as chief customer technology officer.

Keep Reading Show less
Benjamin Pimentel

Benjamin Pimentel ( @benpimentel) covers fintech from San Francisco. He has reported on many of the biggest tech stories over the past 20 years for the San Francisco Chronicle, Dow Jones MarketWatch and Business Insider, from the dot-com crash, the rise of cloud computing, social networking and AI to the impact of the Great Recession and the COVID crisis on Silicon Valley and beyond. He can be reached at bpimentel@protocol.com or via Signal at (510)731-8429.

Protocol | Policy

What can’t Jonathan Kanter do?

Biden's nominee to lead the DOJ's antitrust section may face calls to remove himself from issues as weighty as cracking down on Google and Apple.

DOJ antitrust nominee Jonathan Kanter's work as a corporate lawyer may require him to recuse himself from certain cases.

Photo: New America/Flickr

Jonathan Kanter, President Joe Biden's nominee to run the Justice Department's antitrust division, has been a favorite of progressives, competitors to Big Tech companies and even some Republicans due to his longtime criticism of companies like Google.

But his prior work as a corporate lawyer going after tech giants may require him to recuse himself from some of the DOJ's marquee investigations and cases, including those involving Google and Apple.

Keep Reading Show less
Ben Brody

Ben Brody (@ BenBrodyDC) is a senior reporter at Protocol focusing on how Congress, courts and agencies affect the online world we live in. He formerly covered tech policy and lobbying (including antitrust, Section 230 and privacy) at Bloomberg News, where he previously reported on the influence industry, government ethics and the 2016 presidential election. Before that, Ben covered business news at CNNMoney and AdAge, and all manner of stories in and around New York. He still loves appearing on the New York news radio he grew up with.

Latest Stories