Power

Nreal's plan to beat everyone else to mainstream AR glasses

The Chinese startup is preparing to release $500 AR glasses this year.

Attendees wear Nreal light mixed reality (MR) glasses during CES 2020 in Las Vegas

Nreal 's forthcoming $500 Light AR glasses may well be the first major market test of consumer-grade AR hardware.

Photo: Bridget Bennett/Bloomberg via Getty Images

Chinese startup Nreal thinks it can do what its prominent competitors haven't cracked: produce augmented reality glasses at a price low enough to attract a critical mass of consumers. Its secret weapon? The phone in your pocket.

The company is getting ready to release its $500 Nreal Light AR glasses later this year. With a price tag significantly below that of Microsoft's $3,500 HoloLens headset, as well as the $2300 Magic Leap One, Nreal Light may well be the first major market test of consumer-grade AR hardware.


Get what matters in tech, in your inbox every morning. Sign up for Source Code.


Nreal is leap-frogging Western competitors like Magic Leap and Microsoft with a radically simplified hardware architecture: The company's AR glasses come without the battery and chipsets needed for a standalone headset. Instead, consumers simply plug them into a compatible Android phone to power AR applications. It's a setup that we'll likely see being used by a number of other AR and VR devices to be released in the near future — including Apple's long-rumored AR glasses.

"To us, it's a game-changer," said Anand Agarawala, CEO of the AR teleconferencing startup Spatial, which recently announced a collaboration with Nreal. "We see it as the first AR product that you will see on the street," added Spatial co-founder Jinha Lee.

Mixed reality for everyone

Nreal stumbled across its "bring your own phone" approach by accident, Nreal's Lead Product Manager Wei Lyu told Protocol. The company had always envisioned making its glasses work with external devices, including phones, iPads and even laptops, but still focused on building a dedicated puck for power and processing needs.

But when it showed off both versions at CES 2019, the audience was clearly wowed by the idea of a headset that only requires a phone to work, leading to a shift in direction. "We iterate really fast," Lyu said.

Nreal is still selling a $1,200 dev kit with a dedicated compute unit and external controller to developers, and the company also just previewed plans for an all-in-one enterprise edition that will officially be introduced later this year. However, the clear focus is on the $500 consumer version. "We make mixed reality for everyone," Lyu said.

At launch, Nreal is looking to support high-end phones from brands like Samsung, LG, Sony and OnePlus, as well as Chinese companies like Black Shark, Oppo and Vivo. "We are very focused on trying to make our glasses compatible with most Android phones," Lyu said.

Much like Magic Leap, Nreal allows developers to build dedicated AR apps that superimpose scenes and objects onto the real world. With support for developer environments like Unity and Unreal Engine, this can include anything from games to enterprise solutions like Spatial's AR telepresence solution.

Nreal's AR glasses don't just use phones for power and compute, they also act as a secondary screen for regular Android apps, including games, video-streaming services and productivity applications. The idea is to give consumers a kind of virtual desktop to go, Lyu said.

That's not to say any of this is easy. Apps built for Nreal's glasses will need to be compelling and the technical execution good enough to keep users engaged once the initial wow factor wears off. In the past, adoption of AR and VR hardware has been held back by the lack of so-called killer apps. Cheaper hardware lowers the bar a little bit, but no matter the price, Nreal has to overcome a number of hurdles inherent to the emerging tech.


$31 million in funding and a lawsuit

Nreal was founded in early 2017 by former Magic Leap engineer Xi Chu — a fact that his erstwhile employer is not at all happy about. Magic Leap sued Nreal in June, alleging that Chu stole confidential information from the company to kickstart the development of his own AR glasses.

But the two companies couldn't be more different. Magic Leap has raised some $2.6 billion to date, employs around 2,000 people in 20 offices scattered around the globe, and has been working on its own hardware since 2011. The company said late last year that it was looking to raise hundreds of million dollars more, but has since reportedly engaged in talks to sell itself.

Nreal has only raised $31 million to date and employs around 130 people. Magic Leap argued that both of those data points were proof that the Chinese startup couldn't have built its headset on its own.

Nreal filed a motion to dismiss the case in December, arguing that Magic Leap was simply looking to get rid of a competitor. In her conversation with Protocol, Lyu suggested that Nreal ultimately had a different approach toward AR than Magic Leap, which had spent significant capital on trying to solve hard visual computing challenges, like developing its own waveguide technology.

Nreal uses a much simpler projection technology, which is a lot cheaper to manufacture but still delivers results that have impressed many people. The company also limited the number of cameras and sensors on its device, according to Lyu, further bringing down costs. At the same time, Nreal has been able to add key features expected from modern-day AR and VR headsets, including hand tracking and surface detection. "We are more focused on something that can happen now," she said.

Apple's AR glasses may look similar

There are signs that Nreal is onto something with its take on AR. Apple has reportedly been exploring a similar architecture for its upcoming AR glasses, which could tether to an iPhone for power and compute.

Qualcomm expects multiple AR and VR headsets using the same architecture to ship in the coming months, said the chip maker's GM & VP of XR Hugo Swart during a media briefing for its latest XR reference design last month. Just like Nreal's glasses, these devices could be significantly less expensive than some of the headsets available to date, Swart predicted. "If you remove all the electronics, the build can be very affordable."

Lyu also predicted a bunch of new devices that plug into phones like Nreal's glasses, but didn't seem too worried about the prospect of increased competition. "It's good news for us," she said. "It means Nreal has done something right."

Fintech

Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep Reading Show less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep Reading Show less
FTA
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.
Enterprise

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep Reading Show less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep Reading Show less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.

Enterprise

Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep Reading Show less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories
Bulletins