Snap CTO Bobby Murphy on embracing Apple’s AR glasses

Snap is building its own AR Spectacles, but the company also wants to embrace third-party devices.

Chief Technology Officer at Snap Inc. Bobby Murphy

Bobby Murphy wants Snap’s AR lenses to run everywhere — even on hardware made by competitors.

Photo: Getty Images for Snap Inc

Snap is all in on AR: The Snapchat maker has been building its own AR glasses, and is currently testing an early version with a small group of creators. Snap has also signed up 250,000 creators to build mobile-centric AR experiences through its Lens Studio platform, whose lenses have collectively been viewed over 3.5 trillion times.

Snap celebrated those milestones at its Lens Fest Tuesday, which the company also used to release a number of updates for both mobile and headworn AR. Snap CTO Bobby Murphy recently put that work in context in an interview with Protocol, in which he talked about the company’s progress in building AR Spectacles, why it isn’t focused on non-AR wearables anymore and why it ultimately also wants to build apps and experiences for AR devices made by its competitors.

This interview has been edited and condensed for clarity.

It’s been about half a year since the launch of the new Spectacles with AR. What have you learned from having developers work with that device?

The first thing is just the sheer excitement and passion among our early community of creators. It's just amazing to see how many people are really loving the opportunity to develop AR experiences in a way that aligns with how we all envision the future, even if it is a decade away.

But we're also learning a lot. We are testing the design of inputs, and navigation of experiences in a non-mobile format. All of the work that we're seeing there, all of the imagination and creativity is helping us design around those issues.

These AR Spectacles are only available on an invite-only basis right now. Will you keep making non-AR consumer versions of Spectacles?

For us, the objective of the earlier iterations of Spectacles was to learn from the experience of having any kind of technology on your face, even something as basic as just a camera. We got a ton of insights [on how to] design that thoughtfully, and learn from our community [about] the ways in which people are willing or unwilling to wear glasses when they go about their day, and the use cases and the behavior that would accompany having a pair of glasses with some camera technology on it.

Our main priority going forward is to continue to develop and expand on the AR capabilities of the Spectacles that were announced this year. We'll continue to expand on that, but obviously bring in a lot of the learning that we've had over these last several years with prior versions as well.

A number of other companies are working on consumer AR glasses as well, including Apple and Facebook. Do you eventually want to get to a point where Snap’s software runs on those third-party devices as well?

We've always tried to be as hardware-agnostic as we can be, and leverage the best of what any device has to offer, [even] on our mobile platform. If you look at what we're doing around Camera Kit: Samsung has a carousel of lenses, enabled by Camera Kit, in the native camera of their A-series of [phones]. They are leveraging our technology, our tools, our lens creator and developer community.

We will continue to look for opportunities [like these] to work with any company who is doing innovative work in the space. Whether we are building our own hardware or operating our software on other companies’ hardware, we're going to empower the best form of AR experiences that we can.

Ultimately, you want to do both, right? Build AR glasses and also run on third-party AR hardware?

We already are, through our mobile platform. We are an application, Snapchat, that is built on Apple and Google hardware and Apple and Google platforms. Through Camera Kit, we're powering AR experiences on other applications. And we are also investing in our own hardware, trying to learn and understand what will work best in a new form factor.

How long will it take until we get to mainstream consumer AR glasses? And what are the biggest roadblocks right now?

What's so fascinating about development in this space is that we're balancing a ton of constraints. If we can better understand how these devices are used, which we're doing now through early iterations of Spectacles, we can start to appreciate the experiences that need to be powered, the duration we expect of a lens experience or the capabilities that are really going to create the most engaging experiences. Through all of that learning, we can start to iteratively get to the right sweet spot for this technology. But the biggest [constraints] are probably around battery, compute power and the display of [these] devices.

In terms of timing, I think it will happen more incrementally than people may appreciate. We certainly expect that almost everybody will get value out of wearing a pair of Spectacles or a wearable AR device some day, but that will still be a while.

Until then, we'll continue to develop Spectacles [iteratively]. Today, the battery only works for half an hour. Maybe sometime in the not too distant future, it works for an hour, or two or three hours. Then, you start to come up with places and opportunities and experiences that can fit the constraints of the device. We expect that there will be a lot of opportunities to allow more and more people to engage with AR even in kind of shorter or more controlled experiences well before we get to a truly consumer-ready, always-on, lightweight AR experience.

What could those experiences that give people a glimpse of an AR future look like?

One area that we're excited about is around events. We've already done some really spectacular AR experiences in many different places. We have one down in Art Basel with [the artist] Alex Israel. In his exhibit, you can walk in and use your phone to scan and trigger an amazingly vivid and rich experience. That's something that could be empowered through wearable AR. Maybe you put on a pair of Spectacles, spend 30 minutes walking through an exhibit and then you take it off. Things like that will become more and more interesting and feasible over time.

Fintech

Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep ReadingShow less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep ReadingShow less
FTA
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.
Enterprise

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep ReadingShow less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep ReadingShow less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.

Enterprise

Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep ReadingShow less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories
Bulletins