Snap plans to turn every public space into an AR experience

The company’s new Custom Landmarker feature paves the way for AR wearables and raises questions about discovery and business models.

Image of a new Snap landmarker

Snap's new custom landmarkers allow creators to build AR experiences tied to specific locations, like this indie bookstore in New York.

Image: Snap

Snap wants to take AR everywhere: The Snapchat-maker unveiled Custom Landmarkers Wednesday, allowing its 250,000 lens creators to build AR experiences tied to storefronts, sculptures or any other public landmarks.

The feature is a major step toward a future in which AR glasses allow people to access contextually relevant AR content wherever they go, but it also underscores some of the discovery challenges that lie ahead for ubiquitous AR content.

Snap allows creators to build location-based AR content by using both its Lens Studio desktop software as well as mobile devices. The process involves scanning a landmark with a high-end iPhone with Lidar sensor, and then importing the resulting 3D data into Lens Studio.

Some creators who had early access to Custom Landmarkers have said they were able to create geospatially anchored AR content in as little as one day. “This will hopefully hugely scale the number of locations that are enabled for augmented reality,” said Qi Pan, Snap’s Computer Vision Engineering director.

At launch, Snap is primarily relying on creators posting QR codes to make people aware of AR content tied to a specific location. Pan said that this helps people discover AR content, with the benefit of helping them find something they may not otherwise know to seek out. “You may walk across the most amazing AR activation in your life, but you'll never know it because your phone is in your pocket,” he said. “Snap codes are a very good way to start with.”

Snap built Custom Landmarkers with AR glasses in mind and is encouraging creators who have access to the company’s AR-enabled Spectacles to get involved as well. “The power of this comes from being able to really have interesting content everywhere in the world,” Pan said. “Custom Landmarkers allows us to take the very small step towards that [future].”

Pan cautioned that ubiquitous AR wearables may still be five or 10 years away, but he also acknowledged that discovery will be a key challenge companies like Snap will have to grapple with as they prepare for this future. Today, Snapchat users can scroll through a carousel of lenses to find the AR effects or experiences of their choice. AR glasses may require a very different approach.

“If I regularly take the bus, and I walk across the bus shelter, I may want to see the bus times,” Pan said. “But if I don't take a bus, I [probably] don't care.”

With the release of Custom Landmarkers, Snap will also have to figure out moderation around geospatial AR, which can pit private property rights against freedom of speech. Pan said that the company is relying on its existing content moderation approach, which includes reviewing every lens before it goes live.

At the same time, the company is also trying to figure out how to make location-based AR commercially viable. Ahead of Wednesday’s launch, AR developer studio QReal built a custom landmarker for Yu & Me Books, an independent bookstore in New York’s Chinatown. Pan described this as a model for future cooperations between local businesses and lens creators. The goal was to help developers “create a lens for a bookshop to provide some value, and also earn a living from doing that,” he said.

With Custom Landmarkers now publicly available, Snap also wants to put more effort into turning AR into a communal experience. “The more of these kind of locations we have mapped, the more we can actually have multiple people in these locations interacting together in AR,” Pan said. “I want to transition us from taking videos of solo AR experiences to participating in multiuser AR experiences.”


The minerals we need to save the planet are getting way too expensive

Supply chain problems and rising demand have sent prices spiraling upward for the minerals and metals essential for the clean energy transition.

Critical mineral prices have exploded over the past year.

Photo: Andrey Rudakov/Bloomberg via Getty Images

The newest source of the alarm bells echoing throughout the renewables industry? Spiking critical mineral and metal prices.

According to a new report from the International Energy Agency, a maelstrom of rising demand and tattered supply chains have caused prices for the materials needed for clean energy technologies to soar in the last year. And this increase has only accelerated since 2022 began.

Keep Reading Show less
Lisa Martine Jenkins

Lisa Martine Jenkins is a senior reporter at Protocol covering climate. Lisa previously wrote for Morning Consult, Chemical Watch and the Associated Press. Lisa is currently based in Brooklyn, and is originally from the Bay Area. Find her on Twitter ( @l_m_j_) or reach out via email (ljenkins@protocol.com).

Sponsored Content

Why the digital transformation of industries is creating a more sustainable future

Qualcomm’s chief sustainability officer Angela Baker on how companies can view going “digital” as a way not only toward growth, as laid out in a recent report, but also toward establishing and meeting environmental, social and governance goals.

Three letters dominate business practice at present: ESG, or environmental, social and governance goals. The number of mentions of the environment in financial earnings has doubled in the last five years, according to GlobalData: 600,000 companies mentioned the term in their annual or quarterly results last year.

But meeting those ESG goals can be a challenge — one that businesses can’t and shouldn’t take lightly. Ahead of an exclusive fireside chat at Davos, Angela Baker, chief sustainability officer at Qualcomm, sat down with Protocol to speak about how best to achieve those targets and how Qualcomm thinks about its own sustainability strategy, net zero commitment, other ESG targets and more.

Keep Reading Show less
Chris Stokel-Walker

Chris Stokel-Walker is a freelance technology and culture journalist and author of "YouTubers: How YouTube Shook Up TV and Created a New Generation of Stars." His work has been published in The New York Times, The Guardian and Wired.


The 911 system is outdated. Updating it to the cloud is risky.

Unlike tech companies, emergency services departments can’t afford to make mistakes when migrating to the cloud. Integrating new software in an industry where there’s no margin for error is risky, and sometimes deadly.

In an industry where seconds can mean the difference between life and death, many public safety departments are hesitant to take risks on new cloud-based technologies.

Illustration: Christopher T. Fong/Protocol

Dialing 911 could be the most important phone call you will ever make. But what happens when the software that’s supposed to deliver that call fails you? It may seem simple, but the technology behind a call for help is complicated, and when it fails, deadly.

The infrastructure supporting emergency contact centers is one of the most critical assets for any city, town or local government. But just as the pandemic exposed the creaky tech infrastructure that runs local governments, in many cases the technology in those call centers is outdated and hasn’t been touched for decades.

Keep Reading Show less
Aisha Counts

Aisha Counts (@aishacounts) is a reporter at Protocol covering enterprise software. Formerly, she was a management consultant for EY. She's based in Los Angeles and can be reached at acounts@protocol.com.


'The Wilds' is a must-watch guilty pleasure and more weekend recs

Don’t know what to do this weekend? We’ve got you covered.

Our favorite things this week.

Illustration: Protocol

The East Coast is getting a little preview of summer this weekend. If you want to stay indoors and beat the heat, we have a few suggestions this week to keep you entertained, like a new season of Amazon Prime’s guilty-pleasure show, “The Wilds,” a new game from Horizon Worlds that’s fun for everyone and a sneak peek from Adam Mosseri into what Instagram is thinking about Web3.

Keep Reading Show less
Janko Roettgers

Janko Roettgers (@jank0) is a senior reporter at Protocol, reporting on the shifting power dynamics between tech, media, and entertainment, including the impact of new technologies. Previously, Janko was Variety's first-ever technology writer in San Francisco, where he covered big tech and emerging technologies. He has reported for Gigaom, Frankfurter Rundschau, Berliner Zeitung, and ORF, among others. He has written three books on consumer cord-cutting and online music and co-edited an anthology on internet subcultures. He lives with his family in Oakland.


Work expands to fill the time – but only if you let it

The former Todoist productivity expert drops time-blocking tips, lofi beats playlists for concentrating and other knowledge bombs.

“I do hope the productivity space as a whole is more intentional about pushing narratives that are about life versus just work.”

Photo: Courtesy of Fadeke Adegbuyi

Fadeke Adegbuyi knows how to dole out productivity advice. When she was a marketing manager at Doist, she taught users via blogs and newsletters about how to better organize their lives. Doist, the company behind to-do-list app Todoist and messaging app Twist, has pushed remote and asynchronous work for years. Adegbuyi’s job was to translate these ideas to the masses.

“We were thinking about asynchronous communication from a work point of view, of like: What is most effective for doing ambitious and awesome work, and also, what is most advantageous for living a life that feels balanced?” Adegbuyi said.

Keep Reading Show less
Lizzy Lawrence

Lizzy Lawrence ( @LizzyLaw_) is a reporter at Protocol, covering tools and productivity in the workplace. She's a recent graduate of the University of Michigan, where she studied sociology and international studies. She served as editor in chief of The Michigan Daily, her school's independent newspaper. She's based in D.C., and can be reached at llawrence@protocol.com.

Latest Stories