next-upnext upauthorJanko RoettgersNoneDo you know what's coming next up in the world of tech and entertainment? Get Janko Roettgers' newsletter every Thursday.9147dfd6b1
×

Get access to Protocol

I’ve already subscribed

Will be used in accordance with our Privacy Policy

People

Microsoft wants to take AI voices everywhere

By adding safeguards, Microsoft wants to ensure deepfake voices aren't being abused.

Duolingo Bea character

Duolingo gave its Bea character its own voice, with a little help from some neural networks.

Image: Duolingo

Get ready for every brand and app to have its own voice: Microsoft started to make its custom neural voice product more widely available to commercial partners Wednesday, allowing companies to generate their own voices for chatbots and other interactive applications. Custom neural voices are based on Microsoft's Azure AI platform, and use neural networks to create voices that don't have a robotic sound, like old-school text-to-speech technology.

The company spotlighted some early high-profile customers:

  • AT&T is using custom neural voice tech to bring Bugs Bunny in its Dallas experience store to life. Customers are greeted by name, and can chat with the Looney Tunes character while exploring the store.
  • Progressive created a voice chatbot for Flo, the omnipresent face of the insurance brand.
  • Duolingo is using custom neural voice to create multilingual voices for a set of characters, meant to bring personality to its language-learning app. Soon, you'll be able to choose whether you'd rather get help with your Japanese lessons from an emo teenager, a video game-loving kiddo who eats too much candy or a speed-talker who thinks she is always right.

To create these voices, Microsoft is asking companies to supply them with speech samples; for AT&T's Bugs Bunny, a voice actor recorded 2,000 phrases and lines. Azure AI then uses two neural networks to turn text into speech that actually pronounces words correctly, and also gets the tone and duration of each and every phoneme right.

Microsoft isn't the first company to use AI for custom voices. Google and Amazon have both generated celebrity voices for their respective assistants in the past, and Amazon recently announced that it would white-label Alexa, complete with custom voices. In October, Toronto-based Resemble AI launched Localize, a service that clones voices to produce translated audio recordings in a number of different languages.

With AI getting better and better at creating voices that are indistinguishable from real recordings, we'll likely also see a whole new wave of deepfake audio. Microsoft, for its part, went out of its way to stress that it is aware of the potential for abuse:

  • The company will limit access to its custom neural voice product to pre-approved partners, who have to contractually agree to a code of conduct.
  • Customers also have to agree to add disclaimers to their applications if consumers could mistake an AI voice for a real person.
  • The company is exploring the use of watermarks to make sure that AI recordings aren't used out of context.
  • Microsoft is also asking voice actors to acknowledge within their recordings that they are knowingly participating in an AI voice project — a safeguard against voice hijacking.

"As creators of this technology, we have an obligation to make sure it's used responsibly," said Azure AI platform VP Eric Boyd. "We're careful with the partners we work with in making sure they follow the guidelines."

A version of this story will appear in this week's Next Up newsletter.

People

Making the economy work for Black entrepreneurs

Funding for Black-owned startups needs to grow. That's just the start.

"There is no quick fix to close the racial wealth and opportunity gaps, but there are many ways companies can help," said Mastercard's Michael Froman.

Photo: DigitalVision/Getty Images

Michael Froman is the vice chairman and president of Strategic Growth for Mastercard.

When Tanya Van Court's daughter shared her 9th birthday wish list — a bike and an investment account — Tanya had a moment of inspiration. She wondered whether helping more kids get excited about saving for goals and learning simple financial principles could help them build a pathway to financial security. With a goal of reaching every kid in America, she founded Goalsetter, a savings and financial literacy app for kids. Last month, Tanya brought in backers including NBA stars Kevin Durant and Chris Paul, raising $3.9 million in seed funding.

Keep Reading Show less
Michael Froman
Michael Froman serves as vice chairman and president, Strategic Growth for Mastercard. He and his team drive inclusive growth efforts and partner across public and private sectors to address major societal and economic issues. From 2013 to 2017, Mike served as the U.S. trade representative, President Barack Obama’s principal adviser and negotiator on international trade and investment issues. He is a distinguished fellow of the Council on Foreign Relations and a member of the board of directors of The Walt Disney Company.
Sponsored Content

Building better relationships in the age of all-remote work

How Stripe, Xero and ModSquad work with external partners and customers in Slack channels to build stronger, lasting relationships.

Image: Original by Damian Zaleski

Every business leader knows you can learn the most about your customers and partners by meeting them face-to-face. But in the wake of Covid-19, the kinds of conversations that were taking place over coffee, meals and in company halls are now relegated to video conferences—which can be less effective for nurturing relationships—and email.

Email inboxes, with hard-to-search threads and siloed messages, not only slow down communication but are also an easy target for scammers. Earlier this year, Google reported more than 18 million daily malware and phishing emails related to Covid-19 scams in just one week and more than 240 million daily spam messages.

Keep Reading Show less
Policy

Here are Big Tech’s biggest threats from states

The states are moving much quicker than Congress on privacy, taxes and content moderation.

Virginia is expected to be the second state to pass a comprehensive privacy law.

Photo: Ron Cogswell/Flickr

When critics say that Virginia's new privacy bill is "industry-approved," they're not totally wrong, said David Marsden, the state senator who has been working for months to shepherd the law through the state legislature.

It was an Amazon lobbyist who originally presented Marsden with the text of the bill, which hews closely to the failed Washington Privacy Act, versions of which have been pushed by Microsoft across the country.

Keep Reading Show less
Emily Birnbaum

Emily Birnbaum ( @birnbaum_e) is a tech policy reporter with Protocol. Her coverage focuses on the U.S. government's attempts to regulate one of the most powerful industries in the world, with a focus on antitrust, privacy and politics. Previously, she worked as a tech policy reporter with The Hill after spending several months as a breaking news reporter. She is a Bethesda, Maryland native and proud Kenyon College alumna.

Transforming 2021

Blockchain, QR codes and your phone: the race to build vaccine passports

Digital verification systems could give people the freedom to work and travel. Here's how they could actually happen.

One day, you might not need to carry that physical passport around, either.

Photo: CommonPass

There will come a time, hopefully in the near future, when you'll feel comfortable getting on a plane again. You might even stop at the lounge at the airport, head to the regional office when you land and maybe even see a concert that evening. This seemingly distant reality will depend upon vaccine rollouts continuing on schedule, an open-sourced digital verification system and, amazingly, the blockchain.

Several countries around the world have begun to prepare for what comes after vaccinations. Swaths of the population will be vaccinated before others, but that hasn't stopped industries decimated by the pandemic from pioneering ways to get some people back to work and play. One of the most promising efforts is the idea of a "vaccine passport," which would allow individuals to show proof that they've been vaccinated against COVID-19 in a way that could be verified by businesses to allow them to travel, work or relax in public without a great fear of spreading the virus.

Keep Reading Show less
Mike Murphy

Mike Murphy ( @mcwm) is the director of special projects at Protocol, focusing on the industries being rapidly upended by technology and the companies disrupting incumbents. Previously, Mike was the technology editor at Quartz, where he frequently wrote on robotics, artificial intelligence, and consumer electronics.

Microsoft’s new Viva tool gives ‘productivity’ a more human definition

Getting more done is still the plan, but Microsoft's trying to help keep everyone sane, too.

Viva Connections is just one part of Microsoft's new way of thinking about the employee experience.

Image: Microsoft

Microsoft is launching a new set of tools designed to help companies be more productive. That's not a terribly revolutionary thing for Microsoft to do, but the approach this time is quite different. The new set of tools, called Microsoft Viva, is less about increasing operational efficiency or hitting your KPIs faster, and more about making sure employees are happy, sane and feel taken care of.

While Viva is a set of tools, it's ultimately part of an even larger family: Microsoft's building a new "Employee Experience Platform" to try to help redefine, quantify and achieve a new definition of employee success. The industry Microsoft is trying to capture is worth hundreds of billions of dollars a year, dominated by companies like ServiceNow. And Viva is Microsoft's first foot into the fray. So far, Viva is four things: Viva Learning, a hub for all of a company's training and courses; Viva Topics, an automatically curated library of various internal videos, presentations and other content; Viva Connections, a Facebook Workplace-style intranet that can help people find resources within the company; and Viva Insights, which aims to measure and help improve employee experience.

Keep Reading Show less
David Pierce

David Pierce ( @pierce) is Protocol's editor at large. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.

Latest Stories