People

New Facebook research suggests audio will be key to its AR glasses

Facebook researchers have been working on "perceptual superpowers."

Anechoic Chamber

By explicitly focusing on social situations, Facebook may have found a novel way to drive the adoption of AR glasses.

Image: Facebook

When Facebook eventually launches its own AR glasses, advanced audio features are likely going to be a major selling point. That's the main takeaway from new research coming out of Facebook Reality Labs, the company's recently renamed AR/VR division.

The division's research arm gave a group of journalists a sneak peek at their work this week, highlighting how it aims to both improve consumers' sense of presence in AR and VR through audio and give them the ability to block out background noise and amplify voices in bars and other loud social spaces. And while the researchers stressed that their work was in early stages, they also said that it was all about laying the groundwork for future AR products.

"Once you experience them, it's sort of like the first time you put on a VR headset and you said, 'Wow, this is just different from anything I've ever experienced,'" FRL Research Chief Scientist Michael Abrash said about the two features.

FRL Research Auditory Perception Lead Owen Brimijoin said it "feels like nothing short of magic." Part of that "magic" is making audio that is delivered over headphones indistinguishable from something happening in the room you're in, which could, for instance, make telepresence a lot more lifelike. To achieve this, audio needs to be spatial, meaning that it can be placed in a 3D space, as opposed to just mono or stereo.

Facebook has been using spatial audio to improve immersion for its VR headsets already, but the company's researchers stressed this week that a true sense of audio presence requires a lot more work. For instance, everyone's ear is shaped differently, which is why the company is working on using photographs and videos of people's ears to personalize spatial audio.

Facebook's researchers also outlined their work on "perceptual superpowers," which could turn AR glasses into a kind of situationally aware hearing aid. In essence, Facebook wants to use an array of microphones on its AR glasses to amplify the voice of someone you may be talking to in a crowded bar, while simultaneously blocking out any background noise.

Abrash acknowledged that this feature in particular may raise privacy concerns. "It is something that is very much on our minds as we develop it," he said, adding that Facebook could include safeguards like limiting the reach of such microphones.

However, there is also a potential flip side: By explicitly focusing on social situations, Facebook may have found a novel way to drive the adoption of AR glasses. Previous iterations, from Google Glass to Magic Leap's headset, have been very much focused on delivering features to the wearer of the device alone, prompting the backlash against "glassholes."

Giving wearers of Facebook's upcoming AR glasses the ability to hear others better, and in turn participate more in social settings, might take away a lot of that stigma, and ultimately turn them into more of a utilitarian product that could have a much larger potential customer base.

Policy

Google is wooing a coalition of civil rights allies. It’s working.

The tech giant is adept at winning friends even when it’s not trying to immediately influence people.

A map display of Washington lines the floor next to the elevators at the Google office in Washington, D.C.

Photo: Andrew Harrer/Bloomberg via Getty Images

As Google has faced intensifying pressure from policymakers in recent years, it’s founded trade associations, hired a roster of former top government officials and sometimes spent more than $20 million annually on federal lobbying.

But the company has also become famous in Washington for nurturing less clearly mercenary ties. It has long funded the work of laissez-faire economists who now defend it against antitrust charges, for instance. It’s making inroads with traditional business associations that once pummeled it on policy, and also supports think tanks and advocacy groups.

Keep Reading Show less
Ben Brody

Ben Brody (@ BenBrodyDC) is a senior reporter at Protocol focusing on how Congress, courts and agencies affect the online world we live in. He formerly covered tech policy and lobbying (including antitrust, Section 230 and privacy) at Bloomberg News, where he previously reported on the influence industry, government ethics and the 2016 presidential election. Before that, Ben covered business news at CNNMoney and AdAge, and all manner of stories in and around New York. He still loves appearing on the New York news radio he grew up with.

Sustainability. It can be a charged word in the context of blockchain and crypto – whether from outsiders with a limited view of the technology or from insiders using it for competitive advantage. But as a CEO in the industry, I don’t think either of those approaches helps us move forward. We should all be able to agree that using less energy to get a task done is a good thing and that there is room for improvement in the amount of energy that is consumed to power different blockchain technologies.

So, what if we put the enormous industry talent and minds that have created and developed blockchain to the task of building in a more energy-efficient manner? Can we not just solve the issues but also set the standard for other industries to develop technology in a future-proof way?

Keep Reading Show less
Denelle Dixon, CEO of SDF

Denelle Dixon is CEO and Executive Director of the Stellar Development Foundation, a non-profit using blockchain to unlock economic potential by making money more fluid, markets more open, and people more empowered. Previously, Dixon served as COO of Mozilla. Leading the business, revenue and policy teams, she fought for Net Neutrality and consumer privacy protections and was responsible for commercial partnerships. Denelle also served as general counsel and legal advisor in private equity and technology.

Workplace

Everything you need to know about tech layoffs and hiring slowdowns

Will tech companies and startups continue to have layoffs?

It’s not just early-stage startups that are feeling the burn.

Photo: Kirsty O'Connor/PA Images via Getty Images

What goes up must come down.

High-flying startups with record valuations, huge hiring goals and ambitious expansion plans are now announcing hiring slowdowns, freezes and in some cases widespread layoffs. It’s the dot-com bust all over again — this time, without the cute sock puppet and in the midst of a global pandemic we just can’t seem to shake.

Keep Reading Show less
Nat Rubio-Licht

Nat Rubio-Licht is a Los Angeles-based news writer at Protocol. They graduated from Syracuse University with a degree in newspaper and online journalism in May 2020. Prior to joining the team, they worked at the Los Angeles Business Journal as a technology and aerospace reporter.

Entertainment

Sink into ‘Love, Death & Robots’ and more weekend recs

Don’t know what to do this weekend? We’ve got you covered.

Our favorite picks for your weekend pleasure.

Image: A24; 11 bit studios; Getty Images

We could all use a bit of a break. This weekend we’re diving into Netflix’s beautifully animated sci-fi “Love, Death & Robots,” losing ourselves in surreal “Men” and loving Zelda-like Moonlighter.

Keep Reading Show less
Nick Statt

Nick Statt is Protocol's video game reporter. Prior to joining Protocol, he was news editor at The Verge covering the gaming industry, mobile apps and antitrust out of San Francisco, in addition to managing coverage of Silicon Valley tech giants and startups. He now resides in Rochester, New York, home of the garbage plate and, completely coincidentally, the World Video Game Hall of Fame. He can be reached at nstatt@protocol.com.

Workplace

This machine would like to interview you for a job

Companies are embracing automated video interviews to filter through floods of job applicants. But interviews with a computer screen raise big ethical questions and might scare off candidates.

Although automated interview companies claim to reduce bias in hiring, the researchers and advocates who study AI bias are these companies’ most frequent critics.

Photo: Johner Images via Getty Images

Applying for a job these days is starting to feel a lot like online dating. Job-seekers send their resume into portal after portal and a silent abyss waits on the other side.

That abyss is silent for a reason and it has little to do with the still-tight job market or the quality of your particular resume. On the other side of the portal, hiring managers watch the hundreds and even thousands of resumes pile up. It’s an infinite mountain of digital profiles, most of them from people completely unqualified. Going through them all would be a virtually fruitless task.

Keep Reading Show less
Anna Kramer

Anna Kramer is a reporter at Protocol (Twitter: @ anna_c_kramer, email: akramer@protocol.com), where she writes about labor and workplace issues. Prior to joining the team, she covered tech and small business for the San Francisco Chronicle and privacy for Bloomberg Law. She is a recent graduate of Brown University, where she studied International Relations and Arabic and wrote her senior thesis about surveillance tools and technological development in the Middle East.

Latest Stories
Bulletins