yesAnna KramerNone
×

Get access to Protocol

I’ve already subscribed

Will be used in accordance with our Privacy Policy

People

How a young, queer Asian-American businesswoman is rethinking user safety at Twitter

Transformative and procedural justice are the foundation of Christine Su's vision for a safer site.

How a young, queer Asian-American businesswoman is rethinking user safety at Twitter

"The point is not to make the entire world a safe space: That's not possible," Christine Su said.

Photo: Sarah Deragon, Portraits to the People

About six months ago, Twitter quietly hired someone to become the head of product for conversational safety on the platform. You'd think the person in charge of what might be the most difficult task at Twitter would have a predictable skillset: years of experience in and out of academia, politics and programming; an impenetrable wall of media savvy; close ties to the exec suite. You'd be wrong.

Instead, the woman bringing creative and somewhat radical new ideas to user safety at Twitter is a young "activist-entrepreneur" who spent the last six years running a startup to help ranchers plan climate-friendly grazing practices. Now, only half a year after PastureMap was acquired, Christine Su is the senior product manager for conversational safety at Twitter, tasked with keeping everyday users safe online and rethinking the fundamentals of the platform along the way.

A woman with an MBA and a master's in land use and agriculture might seem like an odd choice, but she's been interested in mission-driven tech work for years. It's what drove her commitment to PastureMap and then her decision to join Twitter. "As a queer women of color who is an Asian American in tech in rural America, that experience is a very intersectional one. I've had plenty of experiences moving through spaces where I wanted more safety," she said. After years of worrying for her sister's safety (she's a journalist covering sensitive topics in the Middle East and now China) as well as her own, Su knew she wanted to focus on building safety and inclusion for people who are the most vulnerable.

Transformative and procedural justice are the foundation of Su's vision for a safer Twitter. The once radical concepts challenge the notion that we should just punish people who cause harm, instead offering an alternative: a pathway to repair the harm that has been done and to prevent its recurrence (transformative justice), and a set of fair rules that make harm rarer in the first place (procedural justice). Transformative justice has recently gained attention for its role in addressing sexual assault on college campuses, and a version of it has been adopted into the official legal system in New Zealand. Academics and activists have argued for years that the concepts could transform conflict resolution.

Su's goals sit at the heart of what could become a very different Twitter one day, if — and it remains a very big conditional — the company is serious about the changes it's been signaling over the last year. Women and people from marginalized groups have documented disproportionate levels of abuse and harassment on the platform for years, and, until recently, Twitter did little to change that. Its content rules stayed stagnant, and time and again, people reported incidences when abuse went ignored and harassment continued unabated. But Twitter has bowed to recent political pressure, expressing clear interest in stricter rules for what people are allowed to do and say.

No matter how many times you monitor, report and moderate harmful posts, the reactionary model does little to reverse the damage that's already been done to the people targeted or to prevent it from happening again, Su said. So instead of putting the spotlight just on the posts causing harm, new functions coming from her team will be all about user control, she explained, giving people a wide range of capabilities to react to situations on the platform. "The point is not to make the entire world a safe space: That's not possible. The point is to empower people and communities to have the tools to heal harm themselves and to prevent harm to themselves and put them in control," Su said.

The product team gave some clues about what that user control could look like when they described the upcoming audio hangout function, Spaces, in a press call last week. Spaces will allow users to determine who is allowed in the audio room and who can speak, and the team is rolling out the function to women and people from other marginalized communities first, to test out how effective these safety functions can be in practice.

Su also cited recent election-related interventions as examples of how reimagining Twitter in the long term could work; for example, the function that encourages people to read content before reposting it has remained in place for now while the team assesses its long-term value. "You've seen over the last year, a willingness of Twitter to rethink its fundamental mechanisms," she said.

For Su, implementing transformative justice means building tools that create private pathways for apologies, forgiveness and deescalation (somehow, we'll get apologies before we get an edit button). While she didn't describe exactly how private apology tools will work just yet, they are intended to become part of "a set of controls that people can take with them around digital spaces, and be able to use them when and if circumstances warrant," she said.

Getting these ideas into practice requires rethinking the bones of Twitter, which is based on a lot of research. "The conversational safety team does a lot of reading," she laughed as she tried to explain how everyone she works with is constantly contributing to a workplace debate about the leading research into procedural justice. These ideas are rooted in more than a decade of work, she said. "Twitter has had time to observe dynamics on the platform. There was a deep literature review of procedural justice that was already there when I arrived." She was also quick to give credit to the researchers pushing these ideas, many of whom have been among Twitter's harshest critics.

If successful, the idea that a social platform could normalize apology would be, quite literally, transformational. It sounds almost too wacky to be true, and therein lies the problem. Su's passion about transformative justice and Twitter's commitment to the idea in reality may be two different things. The same day Su hinted about an upcoming apology tool and designer Maya Patterson touted the company's commitment to making Spaces safe, Twitter rolled out Fleets. And the headlines speak for themselves: "Twitter users say fleets are ripe for harassment" and "Twitter has set itself up for an enormous new content moderation problem."

So I asked Su about her 10-year vision for user safety and how it fits into the Twitter grand plan. "At the highest level, all of us at Twitter are deeply committed to the same mission, which is to serve the public conversation, which is something that I didn't fully appreciate until I got here," she said. "I would like to see more empathy and more thoughtfulness infused into how Twitter works at a fundamental level."

And how does she feel about all the negative feedback along the way? "Feedback is a gift. And feedback at Twitter is a firehose of gifts." While it might be emotionally draining on a personal level to be told "I hope you throw your computer in the garbage," it's still a signal, Su said.

The conversational safety team has big ideas for the next couple of years, and it's growing aggressively to try to make that happen. "We need all the help we can get, so I'm very excited for this article to come out," she said. Su is currently hiring for her machine learning team, which is working to build models that can determine what Twitter users see as a meaningful conversation. "Table stakes is safety, but then we also want to help define what is a meaningful conversation," she said.

Despite all the criticism, Su insisted that everyone at Twitter understands the importance of investing in safety. If nothing else, Twitter can point to hiring people like Su and its plans for growth to prove its commitment. "We have to solve this in order to get to a rich conversation," she said.

Big Tech benefits from Biden’s sweeping immigration actions

Tim Cook and Sundar Pichai praised President Biden's immigration actions, which read like a tech industry wishlist.

Newly-inaugurated President Joe Biden signed two immigration-related executive orders on Wednesday.

Photo: Chip Somodevilla/Getty Images

Immediately after being sworn in as president Wednesday, Joe Biden signed two pro-immigration executive orders and delivered an immigration bill to Congress that reads like a tech industry wishlist. The move drew enthusiastic praise from tech leaders, including Apple CEO Tim Cook and Alphabet CEO Sundar Pichai.

President Biden nullified several of former-President Trump's most hawkish immigration policies. His executive orders reversed the so-called "Muslim ban" and instructed the attorney general and the secretary of Homeland Security to preserve the Deferred Action for Childhood Arrivals, or DACA, program, which the Trump administration had sought to end. He also sent an expansive immigration reform bill to Congress that would provide a pathway to citizenship for undocumented individuals and make it easier for foreign U.S. graduates with STEM degrees to stay in the United States, among other provisions.

Keep Reading Show less
Emily Birnbaum

Emily Birnbaum ( @birnbaum_e) is a tech policy reporter with Protocol. Her coverage focuses on the U.S. government's attempts to regulate one of the most powerful industries in the world, with a focus on antitrust, privacy and politics. Previously, she worked as a tech policy reporter with The Hill after spending several months as a breaking news reporter. She is a Bethesda, Maryland native and proud Kenyon College alumna.

Doxxing insurrectionists: Capitol riot divides online extremism researchers

The uprising has sparked a tense debate about the right way to stitch together the digital scraps of someone's life to publicly accuse them of committing a crime.

Rioters scale the U.S. Capitol walls during the insurrection.

Photo: Blink O'faneye/Flickr

Joan Donovan has a panic button in her office, just in case one of the online extremists she spends her days fighting tries to fight back.

"This is not baby shit," Donovan, who is research director of Harvard's Shorenstein Center on Media, Politics and Public Policy, said. "You do not fuck around with these people in public."

Keep Reading Show less
Issie Lapowsky
Issie Lapowsky (@issielapowsky) is a senior reporter at Protocol, covering the intersection of technology, politics, and national affairs. Previously, she was a senior writer at Wired, where she covered the 2016 election and the Facebook beat in its aftermath. Prior to that, Issie worked as a staff writer for Inc. magazine, writing about small business and entrepreneurship. She has also worked as an on-air contributor for CBS News and taught a graduate-level course at New York University’s Center for Publishing on how tech giants have affected publishing. Email Issie.
Politics

Trump got all he needed from Twitter. Now, he still has all the power.

President Trump used Twitter to become the most powerful man in the world. Now, that power is his to keep.

Trump became the most powerful man in the world thanks to Twitter. Now that he's banned, he'll take that power with him.

Photo: Joshua Hoehne/Unsplash

On Friday night, Twitter announced that it was forever banning President Trump from the digital podium where he conducted his presidency and where, for more than a decade, he built an alternate reality where what he said was always the truth.

There are moral arguments for not doing business with the guy who provoked a violent mob to invade the U.S. Capitol, leaving several people dead. There have been moral arguments for years for not doing business with the guy who spent most of his early mornings and late nights filling the site with a relentless stream of pithy, all-caps conspiracy theories about everything from Barack Obama's birthplace to the 2020 election. There are also moral arguments against tech companies muzzling the president of the United States at all.

Keep Reading Show less
Issie Lapowsky
Issie Lapowsky (@issielapowsky) is a senior reporter at Protocol, covering the intersection of technology, politics, and national affairs. Previously, she was a senior writer at Wired, where she covered the 2016 election and the Facebook beat in its aftermath. Prior to that, Issie worked as a staff writer for Inc. magazine, writing about small business and entrepreneurship. She has also worked as an on-air contributor for CBS News and taught a graduate-level course at New York University’s Center for Publishing on how tech giants have affected publishing. Email Issie.
Politics

Social networks didn’t create a coup. But they helped.

Wednesday's riot at the Capitol should change the way we think about social networks and how information is shared on them.

Rioters in the Senate chambers take photos in front of the dais.

There were so many photos and videos from Wednesday's insurrection on Capitol Hill: The guy with the fur hood taking a picture at the House chamber dais; the group using a riot shield to break the Capitol's windows; the rioters using the barriers meant to keep them out as scaffolding for climbing the wall. But one, to me, sticks out above the rest: A long-haired man in a red, white and blue Trump beanie, carrying a lectern with the seal of the Speaker of the House on it. He's smiling and waving at the camera.

Almost as soon as that photo was taken, it was everywhere. It spread across Twitter, Facebook and Instagram, along with so many other moments from the events in D.C. People in the midst of committing crimes, grinning at the camera. Livestreaming themselves. Tweeting pictures of their every illegal move. Why? Because they went viral. Because the content was the point — the riot was seemingly a "do it for the 'gram" moment as much as anything else. And because, by and large, the upsides of being popular online have a way of outweighing the consequences.

Keep Reading Show less
David Pierce

David Pierce ( @pierce) is Protocol's editor at large. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.

Power

Pressure mounts on tech giants to ban Trump, as rioters storm Capitol

Facebook, Twitter and YouTube removed a video in which Trump expressed love for the rioters, but none of the companies have banned him outright — yet.

Twitter locked President Trump's account.

Image: Twitter

Twitter, Facebook and YouTube took action against several of President Trump's posts Wednesday, labeling the posts, limiting reshares and removing a video in which President Trump expressed his love for rioters who stormed the U.S. Capitol building, leading to the evacuation of the Senate, the deployment of the National Guard and to one person being shot and killed. Twitter locked President Trump's account, requiring him to remove three tweets and saying that his account would remain locked for 12 hours after those tweets were removed. Twitter also warned that any future violations would get him banned. Facebook also locked his account for 24 hours, citing "two policy violations." These actions followed a day of calls from tech investors, academics and others to kick Trump off of their platforms once and for all.

In an early tweet, University of Virginia law professor Danielle Citron implored Twitter CEO Jack Dorsey to take action. "As someone who has served on your Trust and Safety Board since its inception and counseled you since 2009, time is now to suspend President Trump's account," Citron wrote. "He has deliberately incited violence, causing mayhem with his lies and threats."

Keep Reading Show less
Issie Lapowsky
Issie Lapowsky (@issielapowsky) is a senior reporter at Protocol, covering the intersection of technology, politics, and national affairs. Previously, she was a senior writer at Wired, where she covered the 2016 election and the Facebook beat in its aftermath. Prior to that, Issie worked as a staff writer for Inc. magazine, writing about small business and entrepreneurship. She has also worked as an on-air contributor for CBS News and taught a graduate-level course at New York University’s Center for Publishing on how tech giants have affected publishing. Email Issie.
Latest Stories