Snap CTO Bobby Murphy on embracing Apple’s AR glasses

Snap is building its own AR Spectacles, but the company also wants to embrace third-party devices.

Chief Technology Officer at Snap Inc. Bobby Murphy

Bobby Murphy wants Snap’s AR lenses to run everywhere — even on hardware made by competitors.

Photo: Getty Images for Snap Inc

Snap is all in on AR: The Snapchat maker has been building its own AR glasses, and is currently testing an early version with a small group of creators. Snap has also signed up 250,000 creators to build mobile-centric AR experiences through its Lens Studio platform, whose lenses have collectively been viewed over 3.5 trillion times.

Snap celebrated those milestones at its Lens Fest Tuesday, which the company also used to release a number of updates for both mobile and headworn AR. Snap CTO Bobby Murphy recently put that work in context in an interview with Protocol, in which he talked about the company’s progress in building AR Spectacles, why it isn’t focused on non-AR wearables anymore and why it ultimately also wants to build apps and experiences for AR devices made by its competitors.

This interview has been edited and condensed for clarity.

It’s been about half a year since the launch of the new Spectacles with AR. What have you learned from having developers work with that device?

The first thing is just the sheer excitement and passion among our early community of creators. It's just amazing to see how many people are really loving the opportunity to develop AR experiences in a way that aligns with how we all envision the future, even if it is a decade away.

But we're also learning a lot. We are testing the design of inputs, and navigation of experiences in a non-mobile format. All of the work that we're seeing there, all of the imagination and creativity is helping us design around those issues.

These AR Spectacles are only available on an invite-only basis right now. Will you keep making non-AR consumer versions of Spectacles?

For us, the objective of the earlier iterations of Spectacles was to learn from the experience of having any kind of technology on your face, even something as basic as just a camera. We got a ton of insights [on how to] design that thoughtfully, and learn from our community [about] the ways in which people are willing or unwilling to wear glasses when they go about their day, and the use cases and the behavior that would accompany having a pair of glasses with some camera technology on it.

Our main priority going forward is to continue to develop and expand on the AR capabilities of the Spectacles that were announced this year. We'll continue to expand on that, but obviously bring in a lot of the learning that we've had over these last several years with prior versions as well.

A number of other companies are working on consumer AR glasses as well, including Apple and Facebook. Do you eventually want to get to a point where Snap’s software runs on those third-party devices as well?

We've always tried to be as hardware-agnostic as we can be, and leverage the best of what any device has to offer, [even] on our mobile platform. If you look at what we're doing around Camera Kit: Samsung has a carousel of lenses, enabled by Camera Kit, in the native camera of their A-series of [phones]. They are leveraging our technology, our tools, our lens creator and developer community.

We will continue to look for opportunities [like these] to work with any company who is doing innovative work in the space. Whether we are building our own hardware or operating our software on other companies’ hardware, we're going to empower the best form of AR experiences that we can.

Ultimately, you want to do both, right? Build AR glasses and also run on third-party AR hardware?

We already are, through our mobile platform. We are an application, Snapchat, that is built on Apple and Google hardware and Apple and Google platforms. Through Camera Kit, we're powering AR experiences on other applications. And we are also investing in our own hardware, trying to learn and understand what will work best in a new form factor.

How long will it take until we get to mainstream consumer AR glasses? And what are the biggest roadblocks right now?

What's so fascinating about development in this space is that we're balancing a ton of constraints. If we can better understand how these devices are used, which we're doing now through early iterations of Spectacles, we can start to appreciate the experiences that need to be powered, the duration we expect of a lens experience or the capabilities that are really going to create the most engaging experiences. Through all of that learning, we can start to iteratively get to the right sweet spot for this technology. But the biggest [constraints] are probably around battery, compute power and the display of [these] devices.

In terms of timing, I think it will happen more incrementally than people may appreciate. We certainly expect that almost everybody will get value out of wearing a pair of Spectacles or a wearable AR device some day, but that will still be a while.

Until then, we'll continue to develop Spectacles [iteratively]. Today, the battery only works for half an hour. Maybe sometime in the not too distant future, it works for an hour, or two or three hours. Then, you start to come up with places and opportunities and experiences that can fit the constraints of the device. We expect that there will be a lot of opportunities to allow more and more people to engage with AR even in kind of shorter or more controlled experiences well before we get to a truly consumer-ready, always-on, lightweight AR experience.

What could those experiences that give people a glimpse of an AR future look like?

One area that we're excited about is around events. We've already done some really spectacular AR experiences in many different places. We have one down in Art Basel with [the artist] Alex Israel. In his exhibit, you can walk in and use your phone to scan and trigger an amazingly vivid and rich experience. That's something that could be empowered through wearable AR. Maybe you put on a pair of Spectacles, spend 30 minutes walking through an exhibit and then you take it off. Things like that will become more and more interesting and feasible over time.

SKOREA-ENTERTAINMENT-GAMING-MICROSOFT-XBOX
A visitor plays a game using Microsoft's Xbox controller at a flagship store of SK Telecom in Seoul on November 10, 2020. (Photo by Jung Yeon-je / AFP) (Photo by JUNG YEON-JE/AFP via Getty Images)

On this episode of the Source Code podcast: Nick Statt joins the show to discuss Microsoft’s $68.7 billion acquisition of Activision Blizzard, and what it means for the tech and game industries. Then, Issie Lapowsky talks about a big week in antitrust reform, and whether real progress is being made in the U.S. Finally, Hirsh Chitkara explains why AT&T, Verizon, the FAA and airlines have been fighting for months about 5G coverage.

For more on the topics in this episode:

Keep Reading Show less
David Pierce

David Pierce ( @pierce) is Protocol's editorial director. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.

COVID-19 accelerated what many CEOs and CTOs have struggled to do for the past decade: It forced organizations to be agile and adjust quickly to change. For all the talk about digital transformation over the past decade, when push came to shove, many organizations realized they had made far less progress than they thought.

Now with the genie of rapid change out of the bottle, we will never go back to accepting slow and steady progress from our organizations. To survive and thrive in times of disruption, you need to build a resilient, adaptable business with systems and processes that will keep you nimble for years to come. An essential part of business agility is responding to change by quickly developing new applications and adapting old ones. IT faces an unprecedented demand for new applications. According to IDC, by 2023, more than 500 million digital applications and services will be developed and deployed — the same number of apps that were developed in the last 40 years.[1]

Keep Reading Show less
Denise Broady, CMO, Appian
Denise oversees the Marketing and Communications organization where she is responsible for accelerating the marketing strategy and brand recognition across the globe. Denise has over 24+ years of experience as a change agent scaling businesses from startups, turnarounds and complex software companies. Prior to Appian, Denise worked at SAP, WorkForce Software, TopTier and Clarkston Group. She is also a two-time published author of “GRC for Dummies” and “Driven to Perform.” Denise holds a double degree in marketing and production and operations from Virginia Tech.
Policy

Congress’ antitrust push has a hate speech problem

Sen. Klobuchar’s antitrust bill is supposed to promote competition. So why are advocates afraid it could also promote extremists?

The bill as written could make it a lot riskier for large tech companies to deplatform or demote companies that violate their rules.

Photo: Photo by Elizabeth Frantz-Pool/Getty Images

The antitrust bill that passed the Senate Judiciary Committee Thursday and is now headed to the Senate floor is, at its core, an attempt to prevent the likes of Apple, Amazon and Google from boosting their own products and services on the marketplaces and platforms they own.

But upon closer inspection, some experts say, the bill as written could make it a lot riskier for large tech companies to deplatform or demote companies that violate their rules.

Keep Reading Show less
Issie Lapowsky

Issie Lapowsky ( @issielapowsky) is Protocol's chief correspondent, covering the intersection of technology, politics, and national affairs. She also oversees Protocol's fellowship program. Previously, she was a senior writer at Wired, where she covered the 2016 election and the Facebook beat in its aftermath. Prior to that, Issie worked as a staff writer for Inc. magazine, writing about small business and entrepreneurship. She has also worked as an on-air contributor for CBS News and taught a graduate-level course at New York University's Center for Publishing on how tech giants have affected publishing.

Boost 2

Can Matt Mullenweg save the internet?

He's turning Automattic into a different kind of tech giant. But can he take on the trillion-dollar walled gardens and give the internet back to the people?

Matt Mullenweg, CEO of Automattic and founder of WordPress, poses for Protocol at his home in Houston, Texas.
Photo: Arturo Olmos for Protocol

In the early days of the pandemic, Matt Mullenweg didn't move to a compound in Hawaii, bug out to a bunker in New Zealand or head to Miami and start shilling for crypto. No, in the early days of the pandemic, Mullenweg bought an RV. He drove it all over the country, bouncing between Houston and San Francisco and Jackson Hole with plenty of stops in national parks. In between, he started doing some tinkering.

The tinkering is a part-time gig: Most of Mullenweg’s time is spent as CEO of Automattic, one of the web’s largest platforms. It’s best known as the company that runs WordPress.com, the hosted version of the blogging platform that powers about 43% of the websites on the internet. Since WordPress is open-source software, no company technically owns it, but Automattic provides tools and services and oversees most of the WordPress-powered internet. It’s also the owner of the booming ecommerce platform WooCommerce, Day One, the analytics tool Parse.ly and the podcast app Pocket Casts. Oh, and Tumblr. And Simplenote. And many others. That makes Mullenweg one of the most powerful CEOs in tech, and one of the most important voices in the debate over the future of the internet.

Keep Reading Show less
David Pierce

David Pierce ( @pierce) is Protocol's editorial director. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.

Workplace

Ask a tech worker: How many of your colleagues have caught omicron?

Millions of workers called in sick in recent weeks. How is tech handling it?

A record number of Americans called in sick with COVID-19 in recent weeks. Even with high vaccination rates, tech companies aren’t immune.

Illustration: Christopher T. Fong/Protocol

Welcome back to Ask a Tech Worker! For this recurring feature, I’ve been roaming downtown San Francisco at lunchtime to ask tech employees about how the workplace is changing. This week, I caught up with tech workers about what their companies are doing to avoid omicron outbreaks, and whether many of their colleagues had been out sick lately. Got an idea for a future topic? Email me.

Omicron stops for no one, it seems. Between Dec. 29 and Jan. 10, 8.8 million Americans missed work to either recover from COVID-19 or care for someone who was recovering, according to the Census Bureau. That number crushed the previous record of 6.6 million from last January, and tripled the numbers from early last month.

Keep Reading Show less
Allison Levitsky
Allison Levitsky is a reporter at Protocol covering workplace issues in tech. She previously covered big tech companies and the tech workforce for the Silicon Valley Business Journal. Allison grew up in the Bay Area and graduated from UC Berkeley.

The fast-growing paychecks of Big Tech’s biggest names

Tech giants had a huge pandemic, and their execs are getting paid.

TIm Cook received $82 million in stock awards on top of his $3 million salary as Apple's CEO.

Photo: Mario Tama/Getty Images

Tech leaders are making more than ever.

As tech giants thrive amid the pandemic, companies like Meta, Alphabet and Microsoft have continued to pay their leaders accordingly: Big Tech CEO pay is higher than ever. In the coming months, we’ll begin seeing a lot of companies release their executive compensation from the past year as fiscal 2022 begins.

Keep Reading Show less
Nat Rubio-Licht
Nat Rubio-Licht is a Los Angeles-based news writer at Protocol. They graduated from Syracuse University with a degree in newspaper and online journalism in May 2020. Prior to joining the team, they worked at the Los Angeles Business Journal as a technology and aerospace reporter.
Latest Stories
Bulletins