China

Chinese deepfakes are going viral, and Beijing is freaking out

No regulator wants to wait for an incriminating Xi Jinping deepfake before taking action.

Chinese deepfakes are going viral, and Beijing is freaking out

A still from China's latest viral DeepFake.

Protocol screengrab/Zeyi Yang

Beijing announced on Thursday that it has summoned eleven internet companies, including Alibaba, Tencent and ByteDance, over "audio-based social networking apps and apps that involve 'deepfake' technologies."


The announcement from China's Cyberspace Administration and Ministry of Public Security came as a direct response to an obsession among urban elites with Clubhouse-like apps and the rapid proliferation of viral DeepFakes in China. Protocol has covered the rise of the Clubhouse clones here. But what's going on with DeepFakes? Here's what you should know:

  • Thank Russia for China's deepfake craze. At the end of February, Avatarify, an AI-based app developed by Russian engineers that transform static portrait photos into videos, trended on Douyin, the Chinese version of TikTok. Chinese users were quick to find innovative ways to create hilarious videos with the app, including one showing Elon Musk and Jack Ma seemingly singing the popular song Dragostea Din Tei in sync. See for yourself

Clocwise, from top left: Elon Musk, Mark Zuckerberg, Warren Buffet, Jack Ma, Wang Jianlin, Jia Yueting, Lei Jun, Pony Ma.Protocol screengrab/Avatarify

    • Deepfakes have gotten very popular in China very quickly. Over 7 million Douyin users have used similar filters to create videos, and the videos have been watched over 2.7 billion times combined, according to the Chinese outlet TechSina. Taobao vendors started charging to create deepfakes, to people who don't have iPhones and thus can't use Avatarify themselves. On February 28, Avatarify topped the Chinese App Store chart; just two day later, it was pulled for reasons that were not made public.
    • The videos that trended this time were mostly benign, where ordinary users or even celebrities use their own photos for comedic effects. But AI face-swapping technologies have previously been used for creating pornographic content and disinformation. Academic researchers have been cautious in developing the commercial application of deepfake technologies, for this very matter. And no regulator wants to wait until there's a critical or incriminating deepfake of a Politburo member or Xi Jinping before taking action.
    • The summons is essentially Beijing asking tech companies to conduct self-censorship more quickly and thoroughly. The announcement cites a 2018 regulation that required Internet companies to conduct security assessments of their own apps and services when "online services that involve public opinionating or public organizing are introduced," or when "the number of users experiences a significant growth."
    • China's now one of the world's deepfake capitals. According to a deepfake white paper published by Nisos, a cybersecurity intelligence firm, Russia, Japan and China are the three most prominent countries where deepfake creators reside. In China, "the typical deep fake purveyor profile is more likely the hobbyist and researcher," the whitepaper says.
    • Chinese startups are trying to find a profit model for deepfake-like technologies. Surreal, a one-year-old company backed by Sequoia and ZhenFund, said it wanted to become "the Google Translate of videos." It can modify people's facial characteristics and change the language they speak in videos, therefore reducing the cost of international marketing, the founder told Chinese tech publication 36Kr.
    Workplace

    An IPO may soon be in Notion’s future

    Notion COO Akshay Kothari says there’s room to grow, aided by a new CFO who knows how to take a company public.

    Notion has hired its first chief financial officer: Rama Katkar.

    Photo: Courtesy of Notion

    It’s been a year since Notion’s triumphant $275 million funding round and $10 billion valuation. Since then the landscape for productivity startups trying to make it on their own has completely changed, especially for those pandemic darlings that flourished in the all-remote world.

    As recession looms, companies looking to cut costs are less likely to spend money on tools outside of their Microsoft or Google workplace bundles. Enterprise platforms are bulking up and it could spell trouble for the productivity startups trying to unseat them. But Notion COO Akshay Kothari says the company is still aiming to build the next Microsoft, not be the next Microsoft. And in a move signaling a new chapter of maturity, Notion has hired its first chief financial officer: Rama Katkar, Instacart’s former VP of finance.

    Keep Reading Show less
    Lizzy Lawrence

    Lizzy Lawrence ( @LizzyLaw_) is a reporter at Protocol, covering tools and productivity in the workplace. She's a recent graduate of the University of Michigan, where she studied sociology and international studies. She served as editor in chief of The Michigan Daily, her school's independent newspaper. She's based in D.C., and can be reached at llawrence@protocol.com.

    Sponsored Content

    Great products are built on strong patents

    Experts say robust intellectual property protection is essential to ensure the long-term R&D required to innovate and maintain America's technology leadership.

    Every great tech product that you rely on each day, from the smartphone in your pocket to your music streaming service and navigational system in the car, shares one important thing: part of its innovative design is protected by intellectual property (IP) laws.

    From 5G to artificial intelligence, IP protection offers a powerful incentive for researchers to create ground-breaking products, and governmental leaders say its protection is an essential part of maintaining US technology leadership. To quote Secretary of Commerce Gina Raimondo: "intellectual property protection is vital for American innovation and entrepreneurship.”

    Keep Reading Show less
    James Daly
    James Daly has a deep knowledge of creating brand voice identity, including understanding various audiences and targeting messaging accordingly. He enjoys commissioning, editing, writing, and business development, particularly in launching new ventures and building passionate audiences. Daly has led teams large and small to multiple awards and quantifiable success through a strategy built on teamwork, passion, fact-checking, intelligence, analytics, and audience growth while meeting budget goals and production deadlines in fast-paced environments. Daly is the Editorial Director of 2030 Media and a contributor at Wired.
    Securing the Enterprise

    Securing the enterprise

    There’s no let-up in the surge of cyberattacks against businesses. But shutting down the hackers will require many enterprises to evolve their strategy.

    In today’s enterprise, “identity and security are very merged.”

    Illustration: iStock/Getty Images Plus; Protocol
    the Protocol team
    Protocol focuses on the people, power and politics of tech, with no agenda and just one goal: to arm decision-makers in tech, business and public policy with the unbiased, fact-based news and analysis they need to navigate a world in rapid change.
    Fintech

    How neobanks are helping consumers game credit scoring

    The CFPB says it is closely monitoring secured credit cards offered by neobanks.

    Regulators are scrutinizing neobanks' card offerings.

    Photo: Oscar Wong/Moment/Getty Images

    About one in six Americans has a credit score below 619, according to the CFPB. Another 23% have too thin a credit file to score or no file at all. That puts them in a credit trap: To build credit, these consumers need someone to give them a line of credit with which they can demonstrate good financial habits. But with scores that low, few lenders are prepared to offer them anything.

    Neobanks say they can solve the problem through a new twist on secured credit cards. But regulators are already scrutinizing their offerings.

    Keep Reading Show less
    Veronica Irwin

    Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

    Policy

    Steel decided World War II. Chips will decide whatever is next.

    “Chip War: The Fight for the World’s Most Critical Technology” foreshadows the coming battle between nations over semiconductors.

    “Chip War” outlines the nature of the coming battle over semiconductors, showing how the power to produce leading-edge chips fell into the hands of just five companies.

    Image: Scribner; Protocol

    “World War II was decided by steel and aluminum, and followed shortly thereafter by the Cold War, which was defined by atomic weapons,” Chris Miller, a professor at Tufts University’s Fletcher School of Law and Diplomacy, writes in the introduction to his latest book. So what’s next? According to Miller, the next era, including the rivalry between the U.S. and China, is all about computing power.

    That tech rivalry and the story of how the chip industry got from four to 11.8 billion transistors are all part of Miller’s book, “Chip War: The Fight for the World’s Most Critical Technology,” which comes out Oct. 4. “Chip War” outlines the nature of the coming battle over semiconductors, showing how the power to produce leading-edge chips fell into the hands of just five companies: three from the U.S., one from Japan, and one from the Netherlands.

    Keep Reading Show less
    Hirsh Chitkara

    Hirsh Chitkara ( @HirshChitkara) is a reporter at Protocol focused on the intersection of politics, technology and society. Before joining Protocol, he helped write a daily newsletter at Insider that covered all things Big Tech. He's based in New York and can be reached at hchitkara@protocol.com.

    Latest Stories
    Bulletins