Policy

They left Facebook’s integrity team. Now they want the world to know how it works.

Without breaking their NDAs.

A black and white image of Lady Jjustice

The Integrity Institute's goal is to build a network of integrity professionals and work toward a public consensus about the nitty gritty scientific and philosophical questions that integrity teams have mostly tried to answer behind closed doors.

Photo: Oleksandr Berezko / EyeEm / Getty Images

Shortly before he left Facebook in October 2019, Jeff Allen published his last report as a data scientist for the company's integrity team — the team Facebook Papers whistleblower Frances Haugen has recently made famous.

The report revealed, as Allen put it at the time, some "genuinely horrifying" findings. Namely, three years after the 2016 election, troll farms in Kosovo and Macedonia were continuing to operate vast networks of Facebook pages filled with mostly plagiarized content targeting Black Americans and Christian Americans on Facebook. Combined, the troll farms' pages reached 140 million Facebook users a month, dwarfing the reach of even Walmart's Facebook presence.

Not only had Facebook failed to stop its spread, Allen wrote in a 20-page report that was recently leaked to and published by MIT Tech Review, but the vast majority of the network's reach came from Facebook's ranking algorithms.

"I have no problem with Macedonians reaching US audiences," Allen wrote. "But if you just want to write python scripts that scrape social media and anonymously regurgitate content into communities while siphoning off some monetary or influence reward for yourself… well you can fuck right off."

A Facebook spokesperson said the company has taken "aggressive enforcement actions against these kinds of foreign and domestic inauthentic groups" and was doing so even when Allen wrote his report.

Allen left Facebook soon after that for a data scientist job at the Democratic National Committee. He ended his report with a goodbye, saying he was sad about leaving the company because he wouldn't be able "to work on this problem with the level of impact that FB provides."

Two years later, Allen is hoping to prove himself wrong about that last part.

For the last 10 months, he and Sahar Massachi, another former Facebook staffer who helped build the company's election and civic integrity teams from their earliest days, have been quietly creating an independent organization they hope could help not just Facebook, but also the entire tech industry and lawmakers alike navigate some of the trickiest questions facing integrity workers today.

Now, Allen and Massachi, who spoke exclusively with Protocol, are publicly launching the group at a time when those questions are at the white hot core of the international scandal, spurred by Haugen's disclosures.

Called the Integrity Institute, its goal is to build a network of integrity professionals who are currently employed or were previously employed by tech companies and work toward some kind of public consensus about the nitty gritty scientific and philosophical questions that integrity teams have mostly tried to answer behind closed doors.

The group plans to advise policy makers, regulators and the media about how social media platforms work, publish its own research and serve as a sort of open-source resource for small platforms that lack massive integrity teams of their own. Already, Allen and Massachi have briefed Congress and recruited 11 members, who have collectively worked for nine different tech platforms, to the organization. While they don't define themselves as whistleblowers and are "resolutely not breaking our NDAs," Massachi said, they say Haugen's disclosures have sparked a growing interest in the emerging field of integrity work — interest they're eager to capitalize on.

"Frances is exposing a lot of the knobs in the machine that is a modern social media platform," Massachi said. "Now that people know that those knobs exist, we can start having a conversation about what is the science of how these work, what these knobs do and why you would want to turn them in which direction."

Another benefit of the Facebook Papers? "My mom finally kind of understands the kind of work I was doing," Massachi said.

'Emerging science'

Integrity work only really got its name a few years ago when companies like Facebook began assigning teams of researchers to study all the ways their platforms could be misused. Massachi joined Facebook in 2016 and was one of the earliest members of its election integrity team, working on a dashboard to monitor the Alabama special election in 2017 and, later, on Facebook's election war room. He describes his time working on that team and Facebook's civic integrity team as a career highlight, but says the job of an integrity worker was also full of frustration.

"I thought that integrity was heroic, virtuous work that was not getting enough power and attention inside the company," he said. The people whose job it was to make the platform more moral and less messy had to "jump through a lot more hoops than normal product work, and that felt really wrong to me," Massachi said, though he's careful not to bash his former employer as others have. "Our membership has a wide variety of views," he said.

In January, Massachi began reaching out to former Facebook integrity workers, including Allen, to see if they were interested in forming something of a super group outside of the company. He sent potential members a memo laying out the problems on social media platforms, as he sees them, and the potential fixes he would propose.

"Then people would say, 'Well, I agree with 80% of this. I really disagree with the other 20%.' Then I would say, 'Great. The world deserves to hear our disagreements. Let's hash it out in public," Massachi, who also recently completed a fellowship at Harvard's Berkman Klein Center, said. "That was a recruiting tactic."

For Allen, now chief research officer of the institute, the concept of an independent integrity body was something he'd been considering himself for years. "I think this is an idea that crosses a lot of integrity workers' minds," he said. "What does it look like to do this outside the company?"

Jeff Allen and Sahar Massachi Jeff Allen (left) and Sahar Massachi (right)Photos: Courtesy Jeff Allen and Sahar Massachi

In July, Massachi and Allen gathered the group's 11 members for a retreat in Washington, D.C. They bunked up together at Airbnbs and spent their days in a coworking space, trying to come to a consensus on questions only a geek could love, but which matter deeply to billions of people's experience of the internet.

For instance: If a user doesn't follow a specific account, should they ever see posts from that account in their main feed? On Facebook, that happens all the time. On Instagram, it doesn't. Allen's own research at Facebook had shown how troll farms exploit Facebook's ranking algorithm to get mass exposure in the News Feeds of people who didn't even follow them. At the same time, some in the group argued that, in the best case scenario, this can be a way for platforms to share more high-quality content with users who naturally follow low-quality content.

The group compiled the answers they agreed on — that, as it turns out, was not one of them — into a running list it expects to build upon as the community grows. "When I was working on an integrity team, it's really important work, it's under tight constraints, you're working long hours, and there isn't much time to step back and think," Massachi said. "So this is just a venue for integrity workers across all different companies to take a step back and think about this emerging science."

The Institute has won the support of some leaders in the integrity space, including Samidh Chakrabarti, who led the civic integrity team at Facebook before it was dissolved and has since become an outspoken critic of Facebook. "Given the unprecedented influence that digital platforms have on our lives, it is paramount that we bring together the industry's brightest minds to tackle challenges at the intersection of technology and society," Chakrabarti said in a statement to Protocol. "I encourage all those who work in trust and safety and who take their responsibility to the world seriously to join them in this endeavor and I look forward to supporting this work."

Strength in numbers

The Institute also includes members who were, at times, on the opposite side of the table from integrity workers at large tech companies. One such member is Katie Harbath, Facebook's former public policy director, who worked at the company for a decade and who Massachi called a "good faith partner in stress testing solutions from the Integrity team."

"I do think there's some valid questions about how much what they were saying was being prioritized over other things in some of the conversations," Harbath said of integrity workers inside Facebook.

Harbath saw firsthand how difficult it was to balance the integrity team's priorities against the company's larger goals, including growth. "It can be challenging when you have people constantly coming to you, particularly if you weren't on integrity and not working on this, and being told: Your product's going to cause X,Y and Z, and we want to do these things, but that's going to hurt your goals," she said. "It can certainly cause frustration within teams who are like: Wait, leadership told us we had to do these goals, and the integrity team was like: But we were told we have to do these goals."

Coming to any kind of consensus on actual decisions, Harbath said, was often a laborious, time consuming process that required buy-in from the very top. "You would have to get pretty high up into senior leadership before those two teams crossed into somebody that could say: I want to prioritize this thing over that thing," she said.

In a statement to Protocol, Facebook spokesperson Andy Stone said. "No single employee should be able to decide as serious an issue as what content is or isn't allowed on our site or what products get shipped. There's a reason we make our Community Standards public and have a deliberative process for developing our policies, involving teams from across the company as well as consultation with external stakeholders, to make those determinations."

One goal of the institute is to navigate these tricky ethical and technical questions without having to simultaneously navigate a corporate org chart.

Until now, the organization has been funded "out of pocket," Massachi said, "specifically Jeff's pocket." But the group is looking for institutional funding — as long as it doesn't come directly from the companies. Still, Allen and Massachi say they haven't ruled out taking money from funds that are backed by tech executives.

While lawmakers and the media may well be interested in what the group's members have to say, the bigger question is what impact, if any, this group can have inside the companies themselves. Allen and Massachi know better than almost anyone how integrity workers' recommendations can be thwarted or ignored in the face of competing priorities like growth. And through her disclosures, Haugen has also tried to make that point abundantly clear.

If integrity workers are struggling to break through inside the companies that are paying them to do this work, will they really have any better luck working from the outside in?

Allen and Massachi believe they might. For all the attention it's gotten recently, integrity work is still an amorphous and emerging field that's mostly been developed in private. There's no set of minimum standards to gauge a company's success or failure in integrity work the way there is in software engineering or cybersecurity. Allen and Massachi want to turn integrity work into an established discipline of its own.

"You put out the arguments for how to build responsibly or what the actual integrity professional viewpoint is out there, so that people at the companies can point to it internally," Allen said. "So they're not fighting the battle on their own."

A MESSAGE FROM NASDAQ

As we come out of the pandemic, consumers will be even more accustomed to highly flexible, customer-centric digital experiences that let them engage with companies on their own terms. Businesses must consider the impact of an even more digital economy with dynamic buyer behaviors and determine how next-generation customers want to consume products and services and interact with them.

LEARN MORE

LA is a growing tech hub. But not everyone may fit.

LA has a housing crisis similar to Silicon Valley’s. And single-family-zoning laws are mostly to blame.

As the number of tech companies in the region grows, so does the number of tech workers, whose high salaries put them at an advantage in both LA's renting and buying markets.

Photo: Nat Rubio-Licht/Protocol

LA’s tech scene is on the rise. The number of unicorn companies in Los Angeles is growing, and the city has become the third-largest startup ecosystem nationally behind the Bay Area and New York with more than 4,000 VC-backed startups in industries ranging from aerospace to creators. As the number of tech companies in the region grows, so does the number of tech workers. The city is quickly becoming more and more like Silicon Valley — a new startup and a dozen tech workers on every corner and companies like Google, Netflix, and Twitter setting up offices there.

But with growth comes growing pains. Los Angeles, especially the burgeoning Silicon Beach area — which includes Santa Monica, Venice, and Marina del Rey — shares something in common with its namesake Silicon Valley: a severe lack of housing.

Keep Reading Show less
Nat Rubio-Licht

Nat Rubio-Licht is a Los Angeles-based news writer at Protocol. They graduated from Syracuse University with a degree in newspaper and online journalism in May 2020. Prior to joining the team, they worked at the Los Angeles Business Journal as a technology and aerospace reporter.

While there remains debate among economists about whether we are officially in a full-blown recession, the signs are certainly there. Like most executives right now, the outlook concerns me.

In any case, businesses aren’t waiting for the official pronouncement. They’re already bracing for impact as U.S. inflation and interest rates soar. Inflation peaked at 9.1% in June 2022 — the highest increase since November 1981 — and the Federal Reserve is targeting an interest rate of 3% by the end of this year.

Keep Reading Show less
Nancy Sansom

Nancy Sansom is the Chief Marketing Officer for Versapay, the leader in Collaborative AR. In this role, she leads marketing, demand generation, product marketing, partner marketing, events, brand, content marketing and communications. She has more than 20 years of experience running successful product and marketing organizations in high-growth software companies focused on HCM and financial technology. Prior to joining Versapay, Nancy served on the senior leadership teams at PlanSource, Benefitfocus and PeopleMatter.

Policy

SFPD can now surveil a private camera network funded by Ripple chair

The San Francisco Board of Supervisors approved a policy that the ACLU and EFF argue will further criminalize marginalized groups.

SFPD will be able to temporarily tap into private surveillance networks in certain circumstances.

Photo: Justin Sullivan/Getty Images

Ripple chairman and co-founder Chris Larsen has been funding a network of security cameras throughout San Francisco for a decade. Now, the city has given its police department the green light to monitor the feeds from those cameras — and any other private surveillance devices in the city — in real time, whether or not a crime has been committed.

This week, San Francisco’s Board of Supervisors approved a controversial plan to allow SFPD to temporarily tap into private surveillance networks during life-threatening emergencies, large events, and in the course of criminal investigations, including investigations of misdemeanors. The decision came despite fervent opposition from groups, including the ACLU of Northern California and the Electronic Frontier Foundation, which say the police department’s new authority will be misused against protesters and marginalized groups in a city that has been a bastion for both.

Keep Reading Show less
Issie Lapowsky

Issie Lapowsky ( @issielapowsky) is Protocol's chief correspondent, covering the intersection of technology, politics, and national affairs. She also oversees Protocol's fellowship program. Previously, she was a senior writer at Wired, where she covered the 2016 election and the Facebook beat in its aftermath. Prior to that, Issie worked as a staff writer for Inc. magazine, writing about small business and entrepreneurship. She has also worked as an on-air contributor for CBS News and taught a graduate-level course at New York University's Center for Publishing on how tech giants have affected publishing.

Enterprise

These two AWS vets think they can finally solve enterprise blockchain

Vendia, founded by Tim Wagner and Shruthi Rao, wants to help companies build real-time, decentralized data applications. Its product allows enterprises to more easily share code and data across clouds, regions, companies, accounts, and technology stacks.

“We have this thesis here: Cloud was always the missing ingredient in blockchain, and Vendia added it in,” Wagner (right) told Protocol of his and Shruthi Rao's company.

Photo: Vendia

The promise of an enterprise blockchain was not lost on CIOs — the idea that a database or an API could keep corporate data consistent with their business partners, be it their upstream supply chains, downstream logistics, or financial partners.

But while it was one of the most anticipated and hyped technologies in recent memory, blockchain also has been one of the most failed technologies in terms of enterprise pilots and implementations, according to Vendia CEO Tim Wagner.

Keep Reading Show less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Fintech

Kraken's CEO got tired of being in finance

Jesse Powell tells Protocol the bureaucratic obligations of running a financial services business contributed to his decision to step back from his role as CEO of one of the world’s largest crypto exchanges.

Photo: David Paul Morris/Bloomberg via Getty Images

Kraken is going through a major leadership change after what has been a tough year for the crypto powerhouse, and for departing CEO Jesse Powell.

The crypto market is still struggling to recover from a major crash, although Kraken appears to have navigated the crisis better than other rivals. Despite his exchange’s apparent success, Powell found himself in the hot seat over allegations published in The New York Times that he made insensitive comments on gender and race that sparked heated conversations within the company.

Keep Reading Show less
Benjamin Pimentel

Benjamin Pimentel ( @benpimentel) covers crypto and fintech from San Francisco. He has reported on many of the biggest tech stories over the past 20 years for the San Francisco Chronicle, Dow Jones MarketWatch and Business Insider, from the dot-com crash, the rise of cloud computing, social networking and AI to the impact of the Great Recession and the COVID crisis on Silicon Valley and beyond. He can be reached at bpimentel@protocol.com or via Google Voice at (925) 307-9342.

Latest Stories
Bulletins