Niantic prepares for the ‘real-world’ metaverse with new Lightship AR platform

The creator of Pokémon Go has its own vision for the metaverse, and it involves going outside.

A rendering of Niantic's AR metaverse

Niantic thinks the metaverse will be as much about augmenting the world around us as it will be about creating new virtual spaces.

Image: Niantic

Pokémon Go creator Niantic on Monday launched Lightship, its software development platform designed to help app makers create augmented reality products using the set of tools and technologies Niantic has developed internally for its mobile games.

Lightship is many years in the making, having started back in 2018 under the name Niantic Real World Platform. Earlier this year, Niantic rebranded the product as Lightship, expanding on its vision of a full stack AR development platform that can empower everything from education and science apps to location-based mobile games like Pokémon Go and the newly launched Pikmin World.

Niantic has grouped these tools into three categories: real-time mapping, understanding and sharing, the latter meaning multiplayer features like those in Pokémon Go. The mapping and understanding categories are built on years of Niantic's R&D efforts in making AR feel more realistic.

"The semantics and the depth and the meshing capabilities help a developer understand the environment and make content that really blends into the real world," explained Kjell Bronder, a senior director of product management at Niantic, in an interview with Protocol last week.

As an example, he said seeing a ball float through the air in AR means it has to interact with real-world objects in real time. "You'd want [the ball] to bounce off a wall and roll on the floor and then when it hits the grass and rolls into the water, you want it to make a splash. That requires a lot of underlying technology."

Niantic says many of the tools, including semantic segmentation and meshing capabilities, will be free to use for any developer. The company intends to charge an undisclosed fee if an app using its multiplayer API amasses more than 50,000 users, though the multiplayer features of the platform will be available for free for the first six months of use.

Lightship's launch is a critical moment for Niantic and for the broader AR space. The concept of the metaverse — a kind of all-encompassing, next-generation internet we'll inhabit through VR headsets and AR glasses — has taken the tech and gaming industries by storm. That's largely thanks to Facebook's rebranding as Meta after Mark Zuckerberg outlined his bold vision for the future of computing. The metaverse has now entered the zeitgeist as a much sought-after, cutting-edge new frontier that tech and gaming companies, as well as futurists and sci-fi aficionados, predict will transform online identity, gaming, work and communication.

Central to this entire movement are AR glasses and software that do what sophisticated smartphone technology does today, but more seamlessly and realistically by mapping and understanding the real world and then floating virtual images in front of our eyes. Niantic knows we're far off from those hardware products and advanced software becoming reality. But like many metaverse-oriented gaming companies, including Fortnite maker Epic and Roblox, Niantic wants to be on the ground floor by helping create the infrastructure that will power whatever form the metaverse takes and giving that technology away to other app makers.

"We're excited about building this real-world metaverse," Bronder said. "We're a mission-driven company, and it's about inspiring people to explore the world together: How do we find ways to augment the real world so you can actually find new things, learn new things, experience new types of content that fit into the world?"

Bronder said Pokémon Go "is a first peek into what that looks like," but that Niantic "doesn't have a monopoly on good ideas" when it comes to AR and how the technology can transform how we live our lives and the kinds of experiences we have.

"We're early on, and we want to try different things out. Gaming is an amazing place where we get to experiment to try and learn what works and take those learnings and put them into our platform and give that to developers," Bronder added. "We're super stoked about this real-world metaverse."

Niantic itself is working with Qualcomm to develop next-generation AR glasses that may eventually come to market. Meta, too, is working on a number of experimental VR and AR hardware projects in addition to less sophisticated consumer products like its Ray-Ban smart glasses collaboration. Meanwhile, Apple has long been rumored to be working on its own family of devices, though it's not clear whether Apple intends to first launch a VR headset, AR glasses or potentially a mixed-reality product like Microsoft's HoloLens.

Yet none of those hardware efforts right now is concerned with widely available AR technology for smartphones in the way Niantic is, giving the San Francisco-based firm a potential leg up when it comes to competing with larger tech titans on developer tools. Niantic hopes many developers will use its technology and maybe create the next Pokémon Go. To that end, it's funnelling $20 million into AR projects through its venture arm.

"AR is still in the phase where we want to encourage exploration," Bronder said. "Our stronghold and foothold of course is in gaming. But we want to expand from that and look into adjacent industries: education and entertainment, and also wellness. Niantic is about exploration and getting people outside." The goal, he added, is to "keep one foot on solid ground as we start expanding."

Policy

Musk’s texts reveal what tech’s most powerful people really want

From Jack Dorsey to Joe Rogan, Musk’s texts are chock-full of überpowerful people, bending a knee to Twitter’s once and (still maybe?) future king.

“Maybe Oprah would be interested in joining the Twitter board if my bid succeeds,” one text reads.

Photo illustration: Patrick Pleul/picture alliance via Getty Images; Protocol

Elon Musk’s text inbox is a rarefied space. It’s a place where tech’s wealthiest casually commit to spending billions of dollars with little more than a thumbs-up emoji and trade tips on how to rewrite the rules for how hundreds of millions of people around the world communicate.

Now, Musk’s ongoing legal battle with Twitter is giving the rest of us a fleeting glimpse into that world. The collection of Musk’s private texts that was made public this week is chock-full of tech power brokers. While the messages are meant to reveal something about Musk’s motivations — and they do — they also say a lot about how things get done and deals get made among some of the most powerful people in the world.

Keep Reading Show less
Issie Lapowsky

Issie Lapowsky ( @issielapowsky) is Protocol's chief correspondent, covering the intersection of technology, politics, and national affairs. She also oversees Protocol's fellowship program. Previously, she was a senior writer at Wired, where she covered the 2016 election and the Facebook beat in its aftermath. Prior to that, Issie worked as a staff writer for Inc. magazine, writing about small business and entrepreneurship. She has also worked as an on-air contributor for CBS News and taught a graduate-level course at New York University's Center for Publishing on how tech giants have affected publishing.

Sponsored Content

Great products are built on strong patents

Experts say robust intellectual property protection is essential to ensure the long-term R&D required to innovate and maintain America's technology leadership.

Every great tech product that you rely on each day, from the smartphone in your pocket to your music streaming service and navigational system in the car, shares one important thing: part of its innovative design is protected by intellectual property (IP) laws.

From 5G to artificial intelligence, IP protection offers a powerful incentive for researchers to create ground-breaking products, and governmental leaders say its protection is an essential part of maintaining US technology leadership. To quote Secretary of Commerce Gina Raimondo: "intellectual property protection is vital for American innovation and entrepreneurship.”

Keep Reading Show less
James Daly
James Daly has a deep knowledge of creating brand voice identity, including understanding various audiences and targeting messaging accordingly. He enjoys commissioning, editing, writing, and business development, particularly in launching new ventures and building passionate audiences. Daly has led teams large and small to multiple awards and quantifiable success through a strategy built on teamwork, passion, fact-checking, intelligence, analytics, and audience growth while meeting budget goals and production deadlines in fast-paced environments. Daly is the Editorial Director of 2030 Media and a contributor at Wired.
Fintech

Circle’s CEO: This is not the time to ‘go crazy’

Jeremy Allaire is leading the stablecoin powerhouse in a time of heightened regulation.

“It’s a complex environment. So every CEO and every board has to be a little bit cautious, because there’s a lot of uncertainty,” Circle CEO Jeremy Allaire told Protocol at Converge22.

Photo: Circle

Sitting solo on a San Francisco stage, Circle CEO Jeremy Allaire asked tennis superstar Serena Williams what it’s like to face “unrelenting skepticism.”

“What do you do when someone says you can’t do this?” Allaire asked the athlete turned VC, who was beaming into Circle’s Converge22 convention by video.

Keep Reading Show less
Benjamin Pimentel

Benjamin Pimentel ( @benpimentel) covers crypto and fintech from San Francisco. He has reported on many of the biggest tech stories over the past 20 years for the San Francisco Chronicle, Dow Jones MarketWatch and Business Insider, from the dot-com crash, the rise of cloud computing, social networking and AI to the impact of the Great Recession and the COVID crisis on Silicon Valley and beyond. He can be reached at bpimentel@protocol.com or via Google Voice at (925) 307-9342.

Enterprise

Is Salesforce still a growth company? Investors are skeptical

Salesforce is betting that customer data platform Genie and new Slack features can push the company to $50 billion in revenue by 2026. But investors are skeptical about the company’s ability to deliver.

Photo: Marlena Sloss/Bloomberg via Getty Images

Salesforce has long been enterprise tech’s golden child. The company said everything customers wanted to hear and did everything investors wanted to see: It produced robust, consistent growth from groundbreaking products combined with an aggressive M&A strategy and a cherished culture, all operating under the helm of a bombastic, but respected, CEO and team of well-coiffed executives.

Dreamforce is the embodiment of that success. Every year, alongside frustrating San Francisco residents, the over-the-top celebration serves as a battle cry to the enterprise software industry, reminding everyone that Marc Benioff’s mighty fiefdom is poised to expand even deeper into your corporate IT stack.

Keep Reading Show less
Joe Williams

Joe Williams is a writer-at-large at Protocol. He previously covered enterprise software for Protocol, Bloomberg and Business Insider. Joe can be reached at JoeWilliams@Protocol.com. To share information confidentially, he can also be contacted on a non-work device via Signal (+1-309-265-6120) or JPW53189@protonmail.com.

Policy

The US and EU are splitting on tech policy. That’s putting the web at risk.

A conversation with Cédric O, the former French minister of state for digital.

“With the difficulty of the U.S. in finding political agreement or political basis to legislate more, we are facing a risk of decoupling in the long term between the EU and the U.S.”

Photo: David Paul Morris/Bloomberg via Getty Images

Cédric O, France’s former minister of state for digital, has been an advocate of Europe’s approach to tech and at the forefront of the continent’s relations with U.S. giants. Protocol caught up with O last week at a conference in New York focusing on social media’s negative effects on society and the possibilities of blockchain-based protocols for alternative networks.

O said watching the U.S. lag in tech policy — even as some states pass their own measures and federal bills gain momentum — has made him worry about the EU and U.S. decoupling. While not as drastic as a disentangling of economic fortunes between the West and China, such a divergence, as O describes it, could still make it functionally impossible for companies to serve users on both sides of the Atlantic with the same product.

Keep Reading Show less
Ben Brody

Ben Brody (@ BenBrodyDC) is a senior reporter at Protocol focusing on how Congress, courts and agencies affect the online world we live in. He formerly covered tech policy and lobbying (including antitrust, Section 230 and privacy) at Bloomberg News, where he previously reported on the influence industry, government ethics and the 2016 presidential election. Before that, Ben covered business news at CNNMoney and AdAge, and all manner of stories in and around New York. He still loves appearing on the New York news radio he grew up with.

Latest Stories
Bulletins