Chicken Man was trying to be clever.
Calling up banks to trick unsuspecting customer service agents, the scam artist would always play a recording of chickens in the background to mask his voice. Security experts at Pindrop, a voice authentication startup used by major financial institutions to screen 1.1 billion calls last year, got such a kick out of his efforts that they even named a conference room after him. However, Chicken Man couldn't defeat Pindrop's technology, and ultimately helped the company prepare for a new challenge: a typical family's living room.
On Tuesday, Pindrop announced a partnership with TiVo to bring its voice authentication technology to smart TVs and streaming devices. Instead of weeding out fraudsters, the technology is now being used to personalize voice search results and present the right content recommendations to each member of the family. Soon, the company even plans to infer emotional states from a person's voice, and tweak content recommendations accordingly.
Thanks to the unwitting help of fraudsters like Chicken Man, Pindrop has gotten very good at dealing with background noise. During a demo given to Protocol, an Android TV device featuring Pindrop's tech was able to identify two different speakers even with a blender running on high gear, as well as with one of the participants wearing a muffling N95 mask.
Personalization for smart devices is nothing new. Streaming services like Netflix and Disney+ have for years offered user profiles to personalize content recommendations. Similarly, Google and Amazon are both offering consumers a way to personalize responses from their respective voice assistants.
But while the tech and streaming giants require users to actively set up user profiles and authenticate the voices of each member of their household, Pindrop is taking a more organic approach. "We do something called passive clustering," explained CEO Vijay Balasubramaniyan. Pindrop's algorithms analyze over 250 voice characteristics, including intonation, rhythm and style.
In the living room, the technology is being used to develop unique profiles for everyone in the household; the profiles are then connected to content recommendation engines like the one developed by TiVo. Consumers can decide to name the profiles for each family member, but Pindrop doesn't need to know anything about the real identity of each user.
Once the first streaming products powered by Pindrop launch, the startup wants to fine-tune its technology to detect the emotion and age of consumers to further improve recommendations. TiVo has yet to announce any products that will feature Pindrop's technology, but Balasubramaniyan said that we may get an update on that in the next few months. In addition to its legacy DVR business, TiVo also launched its own Android TV streaming dongle last year, and is licensing its voice technology to other companies.
Pindrop's work for the living room also helped the company improve some of its other security efforts. One example: Live call center conversations are typically a lot longer than the voice commands used to search streaming services, but by optimizing for these short phrases, Pindrop was also able to improve its screening of interactions with the kind of automated call center platforms that ask consumers for one-word choices.
"Solving this problem for TV has helped us in the call center world," Balasubramaniyan said.
