Power

This is how Facebook’s Project Aria AR glasses work

Facebook's experimental smart glasses use the same camera sensor as the Oculus Quest 2.

Facebook’s Project Aria smart glasses, Gemini

Facebook's Project Aria smart glasses are called Gemini.

Photo: Facebook/FCC

It's been close to a year since Facebook first announced Project Aria, a research effort to test smart glasses with a small group of employees. The idea behind the project was to have employees use these devices in the wild and collect a bunch of data to help the company figure out what kind of sensors it needs to add to future devices, executives said at the time.

There haven't been many public updates on the project in recent months, aside from a redacted FCC filing for the Project Aria glasses earlier this year. Now, we are getting a first look at how the Project Aria device actually works, thanks to newly published regulatory documents that include the device user manual.

  • Project Aria's hardware is known as Gemini. The device is being called "Gemini EVT," with EVT (engineering valuation test) being a common acronym in the hardware industry for small product test runs of a few dozen units, meant to test both the design and functionality of a product before it is put into actual production.
  • There is no visual AR component. The filing confirmed what Facebook executives have been telling us for some time: Project Aria is all about collecting data, not displaying it. In addition to camera sensors, the manual also mentions a proximity sensor on the inner temple.
  • Gemini Glasses are available with prescription lenses. "If your glasses have prescription lenses, they are intended only for use by the prescribed user," the user manual warns. "The Glasses are not intended for users whose vision cannot be corrected with standard corrective lenses."
  • There's a mobile companion app called Ariane that can be used to set up the device, connect it to a Wi-Fi network, check its battery status and upload collected sensor data. There's also mention of alerts through the mobile app, but it's unclear what these alerts may look like. The manual shows an iOS version of Ariane, and there's no word on whether Facebook has been testing the glasses with an Android companion app as well.
  • The glasses are equipped with four cameras, capable of recording both photos and videos. Photos of the individual device components show that Facebook used the same camera sensors as those that power the Oculus Quest 2. Videos are being recorded in the VRS file format, which contains captures of all four camera streams simultaneously.
  • The hardware interface is fairly pared-down. There's a shutter button, a power button and a mute switch, which "toggles privacy mode on/off," according to the manual. It also has multiple LEDs to signal recording both to the wearer as well as any bystanders.
  • Gemini glasses are using a Qualcomm chipset, and run a customized version of Android that is being called Oculus OS. The USB charging cable, which attaches to the glasses via a magnetic port, is also being used for Android ADB functionality.

Project Aria's Gemini glasses are clearly still an experimental device, and not meant for consumer use. However, the existence of a privacy mode, a relatively simple UI and the companion mobile app are all things that may find their way into future consumer products, including the smart glasses that Facebook is building in partnership with Ray-Ban.

The biggest surprise is perhaps that Facebook used the Quest's camera sensors for these glasses. This could have been a choice of convenience, as the company has experience with these cameras, and may have been able to use a lot of the data it has gained from developing the Quest to get Project Aria off the ground. However, using four of these sensors could also be a sign that Facebook is already testing visual SLAM for future device iterations that will enable full 3D AR experiences.

Enterprise

Why chip companies need the college students dazzled by software jobs

New chip fabricating plants will need tens of thousands of skilled workers who don’t currently exist. Training them means persuading students to look away from jobs at big tech companies.

Intel employees in clean room "bunny suits" work at Intel's D1X factory in Hillsboro, Oregon.

Photo: Intel Corporation

Every morning, Isaiah Morris drives his white Nissan Altima eight miles down Arizona state Route 101 to a sprawling, low-level office park in South Tempe. Inside one of the unassuming buildings adjacent to GoDaddy’s headquarters and a couple of Amazon offices, the Arizona State University student dons a lab coat, safety shoes and prescription goggles as he helps engineer chemicals for a chip manufacturing process called planarization.

Morris is an unusual 21-year-old. When they graduate college, many of his tech-minded peers will opt to work for the likes of Apple, Google and other household names that have enjoyed meteoric growth over the last decade. Jobs at those tech companies symbolize prestige for graduates and their parents in a way that careers with chipmakers like Intel do not.

Keep Reading Show less
Anna Kramer

Anna Kramer is a reporter at Protocol (Twitter: @ anna_c_kramer, email: akramer@protocol.com), where she writes about labor and workplace issues. Prior to joining the team, she covered tech and small business for the San Francisco Chronicle and privacy for Bloomberg Law. She is a recent graduate of Brown University, where she studied International Relations and Arabic and wrote her senior thesis about surveillance tools and technological development in the Middle East.

Businesses are evolving, with current events and competition serving as the catalysts for technology adoption. Events from the pandemic to the ongoing war in Ukraine have exposed the fragility of global supply chains. The topic of sustainability is now on every board room agenda. Industries from manufacturing to retail and everything in between are exploring the latest innovations like process automation, machine learning and AI to identify potential safeguards against future disruption. But according to a recent survey from Boston Consulting Group, while 80% of companies are adopting digital solutions to navigate existing business challenges or opportunities like the ones mentioned, only about 30% successfully digitally transform their business.

For the last 50 years, SAP has worked closely with our customers to solve some of the world’s most intricate problems. We have also seen, and have been a part of, rapid accelerations in technology in response. Across industries, certain paths have emerged to help businesses manage the unexpected challenges over the last few years.

Keep Reading Show less
DJ Paoni

DJ Paoni is the President of SAP North America and is responsible for the strategy, day-to-day operations, and overall customer success in the United States and Canada. Dedicated to helping customers become best-run businesses, DJ has established himself as a trusted advisor who places a high priority on their success. He works with many of SAP North America's 155,000 customers and helps them adopt business and technology best practices across 25 different industries.

Policy

A new UK visa could steal your top tech talent

Without meaningful immigration reform, U.S.-trained foreign graduates could head across the pond.

The U.S. immigration system turns away hundreds of thousands of highly skilled tech workers every year.

Photo: Ben Fathers/AFP via Getty Images

Almost as soon as he took office, President Biden began the work of undoing a lot of the damage the Trump administration did to the U.S. H-1B visa program. He allowed a Trump-era ban on entry by H-1B holders to expire and withdrew a Trump proposal to prohibit H-1B visa holders’ spouses from working in the U.S. More recently, his administration has expanded the number of degrees considered eligible for special STEM OPT visas.

But the U.S. immigration system still turns away hundreds of thousands of highly skilled — and in many cases U.S.-educated — tech workers every year. Now the U.K. is trying to capitalize on the United States’ failure to reform its policy regarding high-skilled immigrants with a new visa that could poach American-trained tech talent across the pond. And there’s good reason to believe it could work.

Keep Reading Show less
Kwasi Gyamfi Asiedu
Kwasi (kway-see) is a fellow at Protocol with an interest in tech policy and climate. Previously, he covered global religion news at the Associated Press in New York. Before that, he was a freelance journalist based out of Accra, Ghana, covering social justice, health, and environment stories. His reporting has been published in The New York Times, Quartz, CNN, The Guardian, and Public Radio International. He can be reached at kasiedu@protocol.com.
Fintech

A new regulator is stepping into the 'rent-a-bank' ring

The CFPB is promising a "close look" at controversial lending partnerships between banks and fintechs.

Rent-a-bank lending for personal loans is getting regulatory attention.

Photo: Attentie Attentie/Unsplash

Consumer groups pushing for banking regulators to crack down on so-called rent-a-bank lending for personal loans may have found a willing watchdog.

Zixta Martinez, deputy director of the Consumer Financial Protection Bureau, said at a recent consumer group conference that the agency is taking a "close look" at the lending partnerships between banks and nonbanks, which are often fintech companies.

Keep Reading Show less
Ryan Deffenbaugh
Ryan Deffenbaugh is a reporter at Protocol focused on fintech. Before joining Protocol, he reported on New York's technology industry for Crain's New York Business. He is based in New York and can be reached at rdeffenbaugh@protocol.com.
Enterprise

Why Thomas Kurian thinks cloud computing is on the brink of a new era

Kurian tapped his enterprise experience from 22 years at Oracle to reshape Google Cloud as an open, hybrid and multicloud player. What comes next?

Google Cloud CEO Thomas Kurian spoke with Protocol.

Photo courtesy of Google/Weinberg-Clark Photography

When Thomas Kurian landed the CEO role at Google Cloud, he was welcomed as a respected technologist and executive bringing 22 years of needed enterprise chops from Oracle for a substantial undertaking: turning an underdog into a heavyweight contender for meeting major corporations’ cloud needs.

At the Google Cloud Next conference in early 2019, Alphabet and Google CEO Sundar Pichai introduced Kurian, then about three months into his tenure, as a “tremendous leader with a powerful vision” who already had met with hundreds of customers and partners and whose “personal productivity is testing the limits of G Suite and Calendar.”

Keep Reading Show less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Latest Stories
Bulletins