Facebook is finally taking organized hate seriously

Last quarter, Facebook removed more organized hate content than foreign terrorist content for the first time in its history.

Facebook is finally taking organized hate seriously
Tech spent years fighting foreign terrorists. Then came the Capitol riot.
Photo: Roberto Schmidt/Getty Images

Facebook has historically cracked down on foreign terrorist threats more aggressively than domestic ones, but new data released by the company Wednesday suggests that might be changing.

Between January and March of 2021, Facebook said it took down more content related to organized hate groups than it did content related to terrorist organizations — the first time that has happened since Facebook began reporting on content violations and enforcement in late 2017.

Overall in the first quarter of 2020, Facebook removed 9.8 million pieces of organized hate content, up from 6.4 million in the last quarter of 2020. That's compared to 9 million pieces of terrorist content that were removed during the first quarter of this year, a slight increase from 8.6 million pieces of terrorist content removed in the last quarter of 2020. On Instagram, the company continued to remove more terrorist content than organized hate content, but the overall volume of content in both categories was significantly smaller than it was on Facebook.

While Facebook prohibits both organized hate and terrorism, enforcement against terrorist organizations has traditionally dwarfed enforcement against domestic hate groups. That's partly to do with governments, including the U.S. government, forcefully pushing social networks to banish foreign terrorist groups, like ISIS and Al Qaeda, while tiptoeing around domestic organizations such as the Oath Keepers or the Proud Boys. In the U.S., the threat posed by those homegrown groups has only recently been prioritized by government officials since the Capitol attack.

The disparity in enforcement is also partly to do with the diffuse, and in some ways, disorganized nature of so-called organized hate groups. "Groups that are less organized and less structured and don't put out official propaganda in the same sort of way, you have to use a different tool kit in order to get at those kinds of entities," Brian Fishman, who leads Facebook's work fighting dangerous individuals and organizations, recently told Protocol.

In the run up to the 2020 election, Facebook began ramping up its efforts to crack down on organized hate groups and militias, banning individuals and groups that had previously had free rein on the platform. Those policies were full of holes, and leaders of those militia groups have since been arrested for storming the Capitol on Jan. 6 as part of schemes that court records show were largely planned on Facebook-owned platforms.

Still, the policy updates, coupled with improved algorithmic detection, appear to have had an impact. "These are improvements in our technology that continue to improve how proactive we are in detecting more violating content," Guy Rosen, Facebook's vice president of integrity, said on a call with reporters.

The uptick in enforcement against organized hate groups tracks with an increase in automated enforcement against hate speech writ large. While Facebook removed slightly less hate speech in the first quarter of 2021 than it did in the last quarter of 2020, actual views of that content decreased. Facebook estimates that in the first quarter, users saw hate speech five or six times per every 10,000 views of content. That's down from about seven or eight views of hate speech for every 10,000 views in the fourth quarter of 2020.

While Facebook's efforts to combat hate speech and hate groups may be progressing, Facebook's enforcement against other particularly sensitive categories of violating content suffered significant setbacks. According to Rosen, Facebook detected two technical issues that interfered with its detection of child sexual abuse material in the fourth quarter of 2020 and the first quarter of 2021. Enforcement against that type of content dropped from 12.4 million pieces of content in the third quarter of 2020 to less than half of that in the fourth quarter of 2020 and first quarter of 2021.

Rosen said the company is in the "process of addressing that and going back retroactively to remove and take action" on any violations Facebook might have missed.

In 2020, Facebook said it also saw a staggering increase in the number of content restrictions required by governments worldwide in order to comply with local laws. According to the report, those requests nearly doubled from 22,120 in the first half of 2020 to 42,606 in the second "driven mainly by increases in requests from the UK, Turkey and Brazil."


Ask a tech worker: How many of your colleagues have caught omicron?

Millions of workers called in sick in recent weeks. How is tech handling it?

A record number of Americans called in sick with COVID-19 in recent weeks. Even with high vaccination rates, tech companies aren’t immune.

Illustration: Christopher T. Fong/Protocol

Welcome back to Ask a Tech Worker! For this recurring feature, I’ve been roaming downtown San Francisco at lunchtime to ask tech employees about how the workplace is changing. This week, I caught up with tech workers about what their companies are doing to avoid omicron outbreaks, and whether many of their colleagues had been out sick lately. Got an idea for a future topic? Email me.

Omicron stops for no one, it seems. Between Dec. 29 and Jan. 10, 8.8 million Americans missed work to either recover from COVID-19 or care for someone who was recovering, according to the Census Bureau. That number crushed the previous record of 6.6 million from last January, and tripled the numbers from early last month.

Keep Reading Show less
Allison Levitsky
Allison Levitsky is a reporter at Protocol covering workplace issues in tech. She previously covered big tech companies and the tech workforce for the Silicon Valley Business Journal. Allison grew up in the Bay Area and graduated from UC Berkeley.

COVID-19 accelerated what many CEOs and CTOs have struggled to do for the past decade: It forced organizations to be agile and adjust quickly to change. For all the talk about digital transformation over the past decade, when push came to shove, many organizations realized they had made far less progress than they thought.

Now with the genie of rapid change out of the bottle, we will never go back to accepting slow and steady progress from our organizations. To survive and thrive in times of disruption, you need to build a resilient, adaptable business with systems and processes that will keep you nimble for years to come. An essential part of business agility is responding to change by quickly developing new applications and adapting old ones. IT faces an unprecedented demand for new applications. According to IDC, by 2023, more than 500 million digital applications and services will be developed and deployed — the same number of apps that were developed in the last 40 years.[1]

Keep Reading Show less
Denise Broady, CMO, Appian
Denise oversees the Marketing and Communications organization where she is responsible for accelerating the marketing strategy and brand recognition across the globe. Denise has over 24+ years of experience as a change agent scaling businesses from startups, turnarounds and complex software companies. Prior to Appian, Denise worked at SAP, WorkForce Software, TopTier and Clarkston Group. She is also a two-time published author of “GRC for Dummies” and “Driven to Perform.” Denise holds a double degree in marketing and production and operations from Virginia Tech.

The fast-growing paychecks of Big Tech’s biggest names

Tech giants had a huge pandemic, and their execs are getting paid.

TIm Cook received $82 million in stock awards on top of his $3 million salary as Apple's CEO.

Photo: Mario Tama/Getty Images

Tech leaders are making more than ever.

As tech giants thrive amid the pandemic, companies like Meta, Alphabet and Microsoft have continued to pay their leaders accordingly: Big Tech CEO pay is higher than ever. In the coming months, we’ll begin seeing a lot of companies release their executive compensation from the past year as fiscal 2022 begins.

Keep Reading Show less
Nat Rubio-Licht
Nat Rubio-Licht is a Los Angeles-based news writer at Protocol. They graduated from Syracuse University with a degree in newspaper and online journalism in May 2020. Prior to joining the team, they worked at the Los Angeles Business Journal as a technology and aerospace reporter.
Boost 2

Can Matt Mullenweg save the internet?

He's turning Automattic into a different kind of tech giant. But can he take on the trillion-dollar walled gardens and give the internet back to the people?

Matt Mullenweg, CEO of Automattic and founder of WordPress, poses for Protocol at his home in Houston, Texas.
Photo: Arturo Olmos for Protocol

In the early days of the pandemic, Matt Mullenweg didn't move to a compound in Hawaii, bug out to a bunker in New Zealand or head to Miami and start shilling for crypto. No, in the early days of the pandemic, Mullenweg bought an RV. He drove it all over the country, bouncing between Houston and San Francisco and Jackson Hole with plenty of stops in national parks. In between, he started doing some tinkering.

The tinkering is a part-time gig: Most of Mullenweg’s time is spent as CEO of Automattic, one of the web’s largest platforms. It’s best known as the company that runs WordPress.com, the hosted version of the blogging platform that powers about 43% of the websites on the internet. Since WordPress is open-source software, no company technically owns it, but Automattic provides tools and services and oversees most of the WordPress-powered internet. It’s also the owner of the booming ecommerce platform WooCommerce, Day One, the analytics tool Parse.ly and the podcast app Pocket Casts. Oh, and Tumblr. And Simplenote. And many others. That makes Mullenweg one of the most powerful CEOs in tech, and one of the most important voices in the debate over the future of the internet.

Keep Reading Show less
David Pierce

David Pierce ( @pierce) is Protocol's editorial director. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.

Hybrid work has some distinct advantages when it comes to onboarding.

Photo: LogMeIn

Jo Deal is the chief human resources officer at LogMeIn. She is responsible for leading global people strategy with a focus on attracting, developing and engaging talent.

The desire for change that sprung up during the pandemic resulted in the highest attrition levels in decades and a fierce war for talent playing out in the market. The Great Resignation forced managers to suddenly make hiring their top priority, and recruitment partners became everyone’s best friend as leaders scrambled to replace key roles within their teams.

Keep Reading Show less
Jo Deal
Jo Deal serves as LogMeIn’s Chief Human Resources Officer. She is responsible for leading global people strategy with a focus on attracting, developing and engaging world class talent by expanding LogMeIn’s reputation as one of tech’s most desirable career destinations, and by providing a collaborative learning environment where employees can grow their careers.

Peloton’s terrible, horrible, no good, very bad year

2022 just started, and Peloton has already halted bike production and is talking about mass layoffs. How did the pandemic darling get here?

How did Peloton go from pandemic star to sinking ship? One answer is the classic problem of supply and demand.

Image: Peloton; Protocol

It’s been a hell of a ride for Peloton. The headlines have been practically nonstop, from 2019’s cringey wife ad to 2021’s series of unfortunate “Sex and The City” events. But in 2020, Peloton could do no wrong. The at-home fitness company saw a 172% spike in sales over the course of that year, buoyed by the pandemic forcing wealthy gym-goers to stay home.

But nothing is ever easy or certain when it comes to Peloton. In the past week, Business Insider reported that Peloton is considering laying off 41% of its sales and marketing staff and closing down stores. CNBC learned that the company has hired McKinsey & Co. to help cut costs. And yesterday, CNBC reported that Peloton is temporarily halting production of its bikes. Peloton shares promptly plunged 24%.

Keep Reading Show less
Lizzy Lawrence

Lizzy Lawrence ( @LizzyLaw_) is a reporter at Protocol, covering tools and productivity in the workplace. She's a recent graduate of the University of Michigan, where she studied sociology and international studies. She served as editor in chief of The Michigan Daily, her school's independent newspaper. She's based in D.C., and can be reached at llawrence@protocol.com.

Latest Stories