People

Google's secret home security superpower: Your smart speaker with its always-on mics

Google speakers are listening to more than just voice commands. Using them for home security could supercharge Google's $450 million ADT deal.

The Google Home speaker on a table

Google announced support for the detection of "critical sounds" for paying subscribers of its Nest Aware home security subscription service in May.

Photo: Thomas Kolnowski/Unsplash

Last week, Reddit user Brazedowl received a curious notification on his phone: Google was telling him that a smoke detector in his home had gone off. Brazedowl, a teacher from North Carolina who goes by Drew in real life, knew about the smoke alarm — he was at home himself and had just fried some sausages in his kitchen. But up until that moment, he had no idea that his smart speaker was able to detect such events. "Google just made my dumb smoke detectors smart," he wrote on Reddit. "Pretty rad."

A Google spokesperson told Protocol that the feature was accidentally enabled for some users through a recent software update and has since been rolled back. But in light of Monday's news that Google invested $450 million — acquiring a 6.6% stake — in home security provider ADT, it may be a sign of things to come for Google, as it hints at the company's secret home security superpower: millions of smart speakers already in people's homes.

Once the deal closes, ADT's more than 20,000 installers will also sell Google-made smart displays, security cameras and other hardware, and ADT will more closely integrate Google technology into its own home security offerings. "The goal is to give customers fewer false alarms, more ways to receive alarm events, and better detection of potential incidents inside and around the home," Google Nest VP and GM Rishi Chandra said in a blog post.

Brazedowl wasn't the only Google smart speaker user receiving a possible preview of this kind of incident detection in recent days. Other Reddit users reported getting security alerts after breaking glassware, as well as some false alarms triggered by sounds like popped bubble wrap and high-frequency noises that could be confused with a smoke alarm.

When Reddit user Brazedowl fried some sausages last week, accidentally setting off a smoke alarm, his Google Home smart speaker sent alerts to his phone.Screenshot: Reddit

Google announced support for the detection of "critical sounds" for paying subscribers of its Nest Aware home security subscription service in May. "Your Nest speakers and displays will notify you if a critical sound is detected, like a smoke alarm or glass breaking, by sending an alert to the Home app," the company wrote in a blog post. "From there, you can hear an audio clip or listen live within the Home app to confirm the alarm."

"A recent software update enabled these alerts on some of our speakers that didn't have a subscription, but we've since rolled that back," a Google spokesperson told Protocol last week. The spokesperson declined to comment on whether Google had any plans to bring the feature to users without subscriptions in the future. Google did announce Monday that ADT customers would get access to Nest Aware over time.

On the one hand, there is some potential for a privacy backlash. Google has long told users that its speakers only actively monitor ambient audio for utterances of the "Hey Google" wake phrase. Any use of far-field microphones for other purposes, especially for users who didn't sign up for advanced monitoring, could result in some consumers rejecting the device category altogether.

On the other hand, the feature does demonstrate how powerful Google's smart speakers can be in the context of home security. Google sold around 30 million smart speakers and displays in 2019 alone, market research company Strategy Analytics estimated earlier this year. All of these devices feature powerful far-field microphones capable of detecting not only voice commands but also environmental noises.

Some of this functionality is less obvious than the detection of blaring smoke alarms. Google's smart displays sense it if someone walks up to them by emitting and monitoring ultrasonic sounds. Right now, this is being used to change the size of fonts on the display, but the same technology could conceivably also be used to detect possible intruders and other movements inside a home.

Google isn't the first company to rely on smart speakers for monitoring; rival Amazon also uses smart speakers to detect fire alarms and other sounds as part of its Ring Alarm security system.

But in a way, it is a very Google-ish approach to home security: The search giant has long made its own cameras and smoke detectors, with mixed success, and largely failed to make a mark when it introduced its very own home security system in 2017.

With its ADT partnership, Google now signals that it is happy to rely on others for the more mundane aspects of home security, including the huge workforce needed to install and troubleshoot window sensors and the like. Instead, Google is bringing to the table what it does best: advanced technology, including millions of cheap speakers with far-field microphones, ready and able to become smart home security sensors.

Fintech

Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep ReadingShow less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep ReadingShow less
FTA
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.
Enterprise

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep ReadingShow less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep ReadingShow less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.

Enterprise

Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep ReadingShow less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories
Bulletins