China

Chinese deepfakes are going viral, and Beijing is freaking out

No regulator wants to wait for an incriminating Xi Jinping deepfake before taking action.

Chinese deepfakes are going viral, and Beijing is freaking out

A still from China's latest viral DeepFake.

Protocol screengrab/Zeyi Yang

Beijing announced on Thursday that it has summoned eleven internet companies, including Alibaba, Tencent and ByteDance, over "audio-based social networking apps and apps that involve 'deepfake' technologies."


The announcement from China's Cyberspace Administration and Ministry of Public Security came as a direct response to an obsession among urban elites with Clubhouse-like apps and the rapid proliferation of viral DeepFakes in China. Protocol has covered the rise of the Clubhouse clones here. But what's going on with DeepFakes? Here's what you should know:

  • Thank Russia for China's deepfake craze. At the end of February, Avatarify, an AI-based app developed by Russian engineers that transform static portrait photos into videos, trended on Douyin, the Chinese version of TikTok. Chinese users were quick to find innovative ways to create hilarious videos with the app, including one showing Elon Musk and Jack Ma seemingly singing the popular song Dragostea Din Tei in sync. See for yourself

Clocwise, from top left: Elon Musk, Mark Zuckerberg, Warren Buffet, Jack Ma, Wang Jianlin, Jia Yueting, Lei Jun, Pony Ma.Protocol screengrab/Avatarify

    • Deepfakes have gotten very popular in China very quickly. Over 7 million Douyin users have used similar filters to create videos, and the videos have been watched over 2.7 billion times combined, according to the Chinese outlet TechSina. Taobao vendors started charging to create deepfakes, to people who don't have iPhones and thus can't use Avatarify themselves. On February 28, Avatarify topped the Chinese App Store chart; just two day later, it was pulled for reasons that were not made public.
    • The videos that trended this time were mostly benign, where ordinary users or even celebrities use their own photos for comedic effects. But AI face-swapping technologies have previously been used for creating pornographic content and disinformation. Academic researchers have been cautious in developing the commercial application of deepfake technologies, for this very matter. And no regulator wants to wait until there's a critical or incriminating deepfake of a Politburo member or Xi Jinping before taking action.
    • The summons is essentially Beijing asking tech companies to conduct self-censorship more quickly and thoroughly. The announcement cites a 2018 regulation that required Internet companies to conduct security assessments of their own apps and services when "online services that involve public opinionating or public organizing are introduced," or when "the number of users experiences a significant growth."
    • China's now one of the world's deepfake capitals. According to a deepfake white paper published by Nisos, a cybersecurity intelligence firm, Russia, Japan and China are the three most prominent countries where deepfake creators reside. In China, "the typical deep fake purveyor profile is more likely the hobbyist and researcher," the whitepaper says.
    • Chinese startups are trying to find a profit model for deepfake-like technologies. Surreal, a one-year-old company backed by Sequoia and ZhenFund, said it wanted to become "the Google Translate of videos." It can modify people's facial characteristics and change the language they speak in videos, therefore reducing the cost of international marketing, the founder told Chinese tech publication 36Kr.
    Fintech

    Data privacy and harassment could spoil Grindr’s Wall Street romance

    As it pursues a long-held goal of going public, the gay dating app has to confront its demons.

    Grindr may finally be a public company.

    Illustration: woocat/iStock/Getty Images Plus; Protocol

    Grindr's looking for more than just a hookup with Wall Street. Finding a stable relationship may be tough.

    The location-based dating app favored by gay men was a pioneer, predating Tinder by three years. It’s bounced from owner to owner after founder Joel Simkhai sold it in 2018 for $245 million. A SPAC merger could be the answer, but businesses serving the LGBTQ+ community have had trouble courting investors. And Grindr has its own unique set of challenges.

    Keep Reading Show less
    Veronica Irwin

    Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol, covering breaking news. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

    Sponsored Content

    Why the digital transformation of industries is creating a more sustainable future

    Qualcomm’s chief sustainability officer Angela Baker on how companies can view going “digital” as a way not only toward growth, as laid out in a recent report, but also toward establishing and meeting environmental, social and governance goals.

    Three letters dominate business practice at present: ESG, or environmental, social and governance goals. The number of mentions of the environment in financial earnings has doubled in the last five years, according to GlobalData: 600,000 companies mentioned the term in their annual or quarterly results last year.

    But meeting those ESG goals can be a challenge — one that businesses can’t and shouldn’t take lightly. Ahead of an exclusive fireside chat at Davos, Angela Baker, chief sustainability officer at Qualcomm, sat down with Protocol to speak about how best to achieve those targets and how Qualcomm thinks about its own sustainability strategy, net zero commitment, other ESG targets and more.

    Keep Reading Show less
    Chris Stokel-Walker

    Chris Stokel-Walker is a freelance technology and culture journalist and author of "YouTubers: How YouTube Shook Up TV and Created a New Generation of Stars." His work has been published in The New York Times, The Guardian and Wired.

    Inside the Crypto Cannabis Club

    As crypto crashes, an NFT weed club holds on to the high.

    The Crypto Cannabis Club’s Discord has 23,000 subscribers, with 28 chapters globally.

    Photo: Nat Rubio-Licht/Protocol

    On a Saturday night in downtown Los Angeles, a group of high strangers gathered in a smoky, colorful venue less than a mile from Crypto.com Arena. The vibe was relaxed but excited, and the partygoers, many of whom were meeting each other for the very first time, greeted each other like old friends, calling each other by their Discord names. The mood was celebratory: The Crypto Cannabis Club, an NFT community for stoners, was gathering to celebrate the launch of its metaverse dispensary.

    The warmth and belonging of the weed-filled party was a contrast to the metaverse store, which was underwhelming by comparison. But the dispensary launch and the NFTs required to buy into the group are just an excuse: As with most Web3 projects, it’s really about the community. Even though crypto is crashing, taking NFTs with it, the Crypto Cannabis Club is unphased, CEO Ryan Hunter told Protocol.

    Keep Reading Show less
    Nat Rubio-Licht

    Nat Rubio-Licht is a Los Angeles-based news writer at Protocol. They graduated from Syracuse University with a degree in newspaper and online journalism in May 2020. Prior to joining the team, they worked at the Los Angeles Business Journal as a technology and aerospace reporter.

    Climate

    The minerals we need to save the planet are getting way too expensive

    Supply chain problems and rising demand have sent prices spiraling upward for the minerals and metals essential for the clean energy transition.

    Critical mineral prices have exploded over the past year.

    Photo: Andrey Rudakov/Bloomberg via Getty Images

    The newest source of the alarm bells echoing throughout the renewables industry? Spiking critical mineral and metal prices.

    According to a new report from the International Energy Agency, a maelstrom of rising demand and tattered supply chains have caused prices for the materials needed for clean energy technologies to soar in the last year. And this increase has only accelerated since 2022 began.

    Keep Reading Show less
    Lisa Martine Jenkins

    Lisa Martine Jenkins is a senior reporter at Protocol covering climate. Lisa previously wrote for Morning Consult, Chemical Watch and the Associated Press. Lisa is currently based in Brooklyn, and is originally from the Bay Area. Find her on Twitter ( @l_m_j_) or reach out via email (ljenkins@protocol.com).

    Enterprise

    The 911 system is outdated. Updating it to the cloud is risky.

    Unlike tech companies, emergency services departments can’t afford to make mistakes when migrating to the cloud. Integrating new software in an industry where there’s no margin for error is risky, and sometimes deadly.

    In an industry where seconds can mean the difference between life and death, many public safety departments are hesitant to take risks on new cloud-based technologies.

    Illustration: Christopher T. Fong/Protocol

    Dialing 911 could be the most important phone call you will ever make. But what happens when the software that’s supposed to deliver that call fails you? It may seem simple, but the technology behind a call for help is complicated, and when it fails, deadly.

    The infrastructure supporting emergency contact centers is one of the most critical assets for any city, town or local government. But just as the pandemic exposed the creaky tech infrastructure that runs local governments, in many cases the technology in those call centers is outdated and hasn’t been touched for decades.

    Keep Reading Show less
    Aisha Counts

    Aisha Counts (@aishacounts) is a reporter at Protocol covering enterprise software. Formerly, she was a management consultant for EY. She's based in Los Angeles and can be reached at acounts@protocol.com.

    Latest Stories
    Bulletins