Protocol | China

Chinese deepfakes are going viral, and Beijing is freaking out

No regulator wants to wait for an incriminating Xi Jinping deepfake before taking action.

Chinese deepfakes are going viral, and Beijing is freaking out

A still from China's latest viral DeepFake.

Protocol screengrab/Zeyi Yang

Beijing announced on Thursday that it has summoned eleven internet companies, including Alibaba, Tencent and ByteDance, over "audio-based social networking apps and apps that involve 'deepfake' technologies."


The announcement from China's Cyberspace Administration and Ministry of Public Security came as a direct response to an obsession among urban elites with Clubhouse-like apps and the rapid proliferation of viral DeepFakes in China. Protocol has covered the rise of the Clubhouse clones here. But what's going on with DeepFakes? Here's what you should know:

  • Thank Russia for China's deepfake craze. At the end of February, Avatarify, an AI-based app developed by Russian engineers that transform static portrait photos into videos, trended on Douyin, the Chinese version of TikTok. Chinese users were quick to find innovative ways to create hilarious videos with the app, including one showing Elon Musk and Jack Ma seemingly singing the popular song Dragostea Din Tei in sync. See for yourself

Clocwise, from top left: Elon Musk, Mark Zuckerberg, Warren Buffet, Jack Ma, Wang Jianlin, Jia Yueting, Lei Jun, Pony Ma.Protocol screengrab/Avatarify

    • Deepfakes have gotten very popular in China very quickly. Over 7 million Douyin users have used similar filters to create videos, and the videos have been watched over 2.7 billion times combined, according to the Chinese outlet TechSina. Taobao vendors started charging to create deepfakes, to people who don't have iPhones and thus can't use Avatarify themselves. On February 28, Avatarify topped the Chinese App Store chart; just two day later, it was pulled for reasons that were not made public.
    • The videos that trended this time were mostly benign, where ordinary users or even celebrities use their own photos for comedic effects. But AI face-swapping technologies have previously been used for creating pornographic content and disinformation. Academic researchers have been cautious in developing the commercial application of deepfake technologies, for this very matter. And no regulator wants to wait until there's a critical or incriminating deepfake of a Politburo member or Xi Jinping before taking action.
    • The summons is essentially Beijing asking tech companies to conduct self-censorship more quickly and thoroughly. The announcement cites a 2018 regulation that required Internet companies to conduct security assessments of their own apps and services when "online services that involve public opinionating or public organizing are introduced," or when "the number of users experiences a significant growth."
    • China's now one of the world's deepfake capitals. According to a deepfake white paper published by Nisos, a cybersecurity intelligence firm, Russia, Japan and China are the three most prominent countries where deepfake creators reside. In China, "the typical deep fake purveyor profile is more likely the hobbyist and researcher," the whitepaper says.
    • Chinese startups are trying to find a profit model for deepfake-like technologies. Surreal, a one-year-old company backed by Sequoia and ZhenFund, said it wanted to become "the Google Translate of videos." It can modify people's facial characteristics and change the language they speak in videos, therefore reducing the cost of international marketing, the founder told Chinese tech publication 36Kr.

    Theranos’ investor pitches go on trial

    Prosecutors in the Elizabeth Holmes fraud case are now highlighting allegations the company sought to mislead investors.

    The fresh details of unproven claims made about the viability of Theranos' blood tests and efforts to conceal errors when demonstrating testing equipment added to the evidence against Holmes, who is accused of fraud in her role leading the company.

    Photo: David Paul Morris/Bloomberg via Getty Images

    The Theranos trial continued this week with testimony from Daniel Edlin, a former product manager at the blood-testing startup, and Shane Weber, a scientist from Pfizer. Their testimonies appeared to bolster the government's argument that Holmes intentionally defrauded investors and patients.

    The fresh details about audacious and unproven claims made about the viability of Theranos' blood tests and efforts to conceal errors when demonstrating testing equipment added to the evidence against Holmes, who is accused of fraud in her role leading the company.

    Keep Reading Show less
    Aisha Counts

    Aisha Counts (@aishacounts) is a reporting fellow at Protocol, based out of Los Angeles. Previously, she worked for Ernst & Young, where she researched and wrote about the future of work, emerging technologies and startups. She is a graduate of the University of Southern California, where she studied business and philosophy. She can be reached at acounts@protocol.com.

    The way we work has fundamentally changed. COVID-19 upended business dealings and office work processes, putting into hyperdrive a move towards digital collaboration platforms that allow teams to streamline processes and communicate from anywhere. According to the International Data Corporation, the revenue for worldwide collaboration applications increased 32.9 percent from 2019 to 2020, reaching $22.6 billion; it's expected to become a $50.7 billion industry by 2025.

    "While consumers and early adopter businesses had widely embraced collaborative applications prior to the pandemic, the market saw five years' worth of new users in the first six months of 2020," said Wayne Kurtzman, research director of social and collaboration at IDC. "This has cemented collaboration, at least to some extent, for every business, large and small."

    Keep Reading Show less
    Kate Silver

    Kate Silver is an award-winning reporter and editor with 15-plus years of journalism experience. Based in Chicago, she specializes in feature and business reporting. Kate's reporting has appeared in the Washington Post, The Chicago Tribune, The Atlantic's CityLab, Atlas Obscura, The Telegraph and many other outlets.

    Protocol | Policy

    8 takeaways from states’ new filing against Google

    New details have been unsealed in the states' antitrust suit against Google for anticompetitive behavior in the ads market.

    Google is facing complaints by government competition enforcers on several fronts.

    Photo: Drew Angerer/Getty Images

    Up to 22%: That's the fee Google charges publishers for sales on its online ad exchanges, according to newly unredacted details in a complaint by several state attorneys general.

    The figure is just one of the many details that a court allowed the states to unveil Friday. Many had more or less remained secrets inside Google and the online publishing industry, even through prior legal complaints and eager public interest.

    Keep Reading Show less
    Ben Brody

    Ben Brody (@ BenBrodyDC) is a senior reporter at Protocol focusing on how Congress, courts and agencies affect the online world we live in. He formerly covered tech policy and lobbying (including antitrust, Section 230 and privacy) at Bloomberg News, where he previously reported on the influence industry, government ethics and the 2016 presidential election. Before that, Ben covered business news at CNNMoney and AdAge, and all manner of stories in and around New York. He still loves appearing on the New York news radio he grew up with.

    Protocol | Workplace

    This tech founder uses a converted Sprinter van as an office on wheels

    The CEO of productivity startup Rock likes to work on the road. Here's how he does it — starting with three different WiFi hotspots.

    Kenzo Fong, founder and CEO of the 20-person productivity software startup Rock, has been working out of his converted Mercedes-Benz Sprinter van since the pandemic began.

    Photo: Kenzo Fong/Rock

    Plenty of techies have started companies in garages. Try running a startup from a van.

    In San Francisco, one software company founder has been using a converted Mercedes-Benz Sprinter van — picture an Amazon delivery vehicle — as a mobile office.

    Keep Reading Show less
    Allison Levitsky
    Allison Levitsky is a reporter at Protocol covering workplace issues in tech. She previously covered big tech companies and the tech workforce for the Silicon Valley Business Journal. Allison grew up in the Bay Area and graduated from UC Berkeley.
    Protocol | Policy

    Most Americans want AI regulation — and they want it yesterday

    In a poll, people said they wanted to see artificial intelligence technologies develop in the U.S. — alongside rules governing their use.

    U.S. lawmakers have only just begun the long process of regulating the use of AI.

    Photo: Louis Velazquez/Unsplash

    Nearly two-thirds of Americans want the U.S to regulate the development and use of artificial intelligence in the next year or sooner — with half saying that regulation should have begun yesterday, according to a Morning Consult poll. Another 13% say that regulation should start in the next year.

    "You can thread this together," Austin Carson, founder of new nonprofit group SeedAI and former government relations lead for Nvidia, said in an email. "Half or more Americans want to address all of these things, split pretty evenly along ideological lines."

    Keep Reading Show less
    Ben Brody

    Ben Brody (@ BenBrodyDC) is a senior reporter at Protocol focusing on how Congress, courts and agencies affect the online world we live in. He formerly covered tech policy and lobbying (including antitrust, Section 230 and privacy) at Bloomberg News, where he previously reported on the influence industry, government ethics and the 2016 presidential election. Before that, Ben covered business news at CNNMoney and AdAge, and all manner of stories in and around New York. He still loves appearing on the New York news radio he grew up with.

    ai
    Latest Stories