People

IBM exits facial recognition, but that doesn’t mean it’s cutting ties with police

The tech giant still sells AI tools to police departments that experts say can entrench racial bias in law enforcement.

People at a Black Lives Matter protest

For all of IBM's recommendations — including investing in education and holding police accountable for misconduct — the company stopped short of cutting its many other ties with police departments.

Photo: Stanton Sharpe/SOPA Images/LightRocket via Getty Images

In a letter to Congress this week, IBM's CEO Arvind Krishna said the company is no longer offering facial recognition tools and called on Congress to regulate the use of the controversial technology by police, as part of a list of proposals to tackle racial injustice in America.

The news, which came amid widespread protests against police brutality, earned IBM praise and calls for other tech giants, including Amazon, to do the same. But for all of IBM's recommendations — including investing in education and holding police accountable for misconduct — the company stopped short of cutting its many other ties with police departments. That includes the sale of artificial intelligence tools that enable police to predict criminal activity, a practice researchers and advocates say can entrench and exacerbate racial bias in policing.

In his letter, Krishna wrote that the company opposes the use of "any technology, including facial recognition technology offered by other vendors, for mass surveillance, racial profiling, violations of basic human rights and freedoms, or any purpose which is not consistent with our values."

But IBM spokesperson Adam Pratt declined to comment on whether that will have any impact on the company's predictive policing work, saying that the letter was clear on what IBM supports and opposes. Pratt suggested, instead, that Protocol write about how IBM is "stepping up with some of the most detailed policy recommendations we've seen yet from the business community to advance racial justice for the black community and respond to this critical moment in our nation's history."

On its website, IBM touts its policing work, including case studies from Rochester, New York; Miami-Dade, Florida; Durham, North Carolina; and Manchester, New Hampshire. In Miami-Dade County, IBM said it developed technology to help the police "identify crime hot spots" and "model what kind of suspect typically commits a particular crime and then generate and filter a suspect list to help solve cases faster." In Rochester, IBM said its technology gives police making traffic stops insight into not just who owns a given car, but who might be riding in it, painting a "comprehensive picture of an individual, their associates and their activity."

Experts say the problem with making crime or threat predictions based on historical policing data is that the data itself is a reflection of the disproportionate presence of police in black and brown people's lives. In a 2019 paper, Rashida Richardson and her colleagues at New York University's AI Now Institute called this "dirty data" because it's based on "data produced during documented periods of flawed, racially biased, and sometimes unlawful practices and policies." That can include data on calls for service in a given area or even arrest and stop data that omits whether a person was ever convicted of a crime.

"In policing, the data is going to reflect its environment," Richardson said. "If you have a culture of policing that has racial biases evident in its practices and outcomes and a culture that seems to have a complete disregard for entire parts of the population, that's going to be reflected in the data."

Some police departments have taken it upon themselves to terminate predictive policing programs. Last year, the Los Angeles Police Department shut down a controversial program known as LASER, which used technology developed by Palantir to compile a watch list for police. An internal audit found that some 84% of people considered "active chronic offenders" under LASER were black or Latino, and that nearly half of the supposed chronic offenders had never been arrested for a violent crime or had been arrested only once.

Richardson called IBM's letter a "PR move," in part, because it doesn't grapple with the other ways its AI tools are used in policing and, in part, because IBM wasn't the biggest player offering facial recognition technology to law enforcement to begin with. "It's easy to end selling a product that wasn't one of your major profit-drivers," Richardson said, "but it's also harder to take their move seriously when they didn't seem to comment on and don't seem to have an interest in divesting from predictive policing."

In his letter, Krishna wrote that both vendors and users of AI systems in policing need to test their technology for racial bias and have those tests audited. This, coupled with IBM's stance on facial recognition, is an important first step, said Albert Fox Cahn, founder and executive director of the Surveillance Technology Oversight Project, which opposes police surveillance. But, he said, it's only a first step.

"I think the same moral calculus that required IBM to ditch biased and broken facial recognition software will lead them to eventually walk away from the other ways that artificial intelligence can exacerbate police violence and civil rights abuses," Cahn said. "I don't think this is the end of this debate, but I do think it's a lead other tech companies need to follow."

Hybrid work has some distinct advantages when it comes to onboarding.

Photo: LogMeIn

Jo Deal is the chief human resources officer at LogMeIn. She is responsible for leading global people strategy with a focus on attracting, developing and engaging talent.

The desire for change that sprung up during the pandemic resulted in the highest attrition levels in decades and a fierce war for talent playing out in the market. The Great Resignation forced managers to suddenly make hiring their top priority, and recruitment partners became everyone’s best friend as leaders scrambled to replace key roles within their teams.

Keep Reading Show less
Jo Deal
Jo Deal serves as LogMeIn’s Chief Human Resources Officer. She is responsible for leading global people strategy with a focus on attracting, developing and engaging world class talent by expanding LogMeIn’s reputation as one of tech’s most desirable career destinations, and by providing a collaborative learning environment where employees can grow their careers.
Sponsored Content

A CCO’s viewpoint on top enterprise priorities in 2022

The 2022 non-predictions guide to what your enterprise is working on starting this week

As Honeywell’s global chief commercial officer, I am privileged to have the vantage point of seeing the demands, challenges and dynamics that customers across the many sectors we cater to are experiencing and sharing.

This past year has brought upon all businesses and enterprises an unparalleled change and challenge. This was the case at Honeywell, for example, a company with a legacy in innovation and technology for over a century. When I joined the company just months before the pandemic hit we were already in the midst of an intense transformation under the leadership of CEO Darius Adamczyk. This transformation spanned our portfolio and business units. We were already actively working on products and solutions in advanced phases of rollouts that the world has shown a need and demand for pre-pandemic. Those included solutions in edge intelligence, remote operations, quantum computing, warehouse automation, building technologies, safety and health monitoring and of course ESG and climate tech which was based on our exceptional success over the previous decade.

Keep Reading Show less
Jeff Kimbell
Jeff Kimbell is Senior Vice President and Chief Commercial Officer at Honeywell. In this role, he has broad responsibilities to drive organic growth by enhancing global sales and marketing capabilities. Jeff has nearly three decades of leadership experience. Prior to joining Honeywell in 2019, Jeff served as a Partner in the Transformation Practice at McKinsey & Company, where he worked with companies facing operational and financial challenges and undergoing “good to great” transformations. Before that, he was an Operating Partner at Silver Lake Partners, a global leader in technology and held a similar position at Cerberus Capital LP. Jeff started his career as a Manufacturing Team Manager and Engineering Project Manager at Procter & Gamble before becoming a strategy consultant at Bain & Company and holding executive roles at Dell EMC and Transamerica Corporation. Jeff earned a B.S. in electrical engineering at Kansas State University and an M.B.A. at Dartmouth College.
Entertainment

Peloton’s terrible, horrible, no good, very bad year

2022 just started, and Peloton has already halted bike production and is talking about mass layoffs. How did the pandemic darling get here?

How did Peloton go from pandemic star to sinking ship? One answer is the classic problem of supply and demand.

Image: Peloton; Protocol

It’s been a hell of a ride for Peloton. The headlines have been practically nonstop, from 2019’s cringey wife ad to 2021’s series of unfortunate “Sex and The City” events. But in 2020, Peloton could do no wrong. The at-home fitness company saw a 172% spike in sales over the course of that year, buoyed by the pandemic forcing wealthy gym-goers to stay home.

But nothing is ever easy or certain when it comes to Peloton. In the past week, Business Insider reported that Peloton is considering laying off 41% of its sales and marketing staff and closing down stores. CNBC learned that the company has hired McKinsey & Co. to help cut costs. And yesterday, CNBC reported that Peloton is temporarily halting production of its bikes. Peloton shares promptly plunged 24%.

Keep Reading Show less
Lizzy Lawrence

Lizzy Lawrence ( @LizzyLaw_) is a reporter at Protocol, covering tools and productivity in the workplace. She's a recent graduate of the University of Michigan, where she studied sociology and international studies. She served as editor in chief of The Michigan Daily, her school's independent newspaper. She's based in D.C., and can be reached at llawrence@protocol.com.

Boost 2

Can Matt Mullenweg save the internet?

He's turning Automattic into a different kind of tech giant. But can he take on the trillion-dollar walled gardens and give the internet back to the people?

Matt Mullenweg, CEO of Automattic and founder of WordPress, poses for Protocol at his home in Houston, Texas.
Photo: Arturo Olmos for Protocol

In the early days of the pandemic, Matt Mullenweg didn't move to a compound in Hawaii, bug out to a bunker in New Zealand or head to Miami and start shilling for crypto. No, in the early days of the pandemic, Mullenweg bought an RV. He drove it all over the country, bouncing between Houston and San Francisco and Jackson Hole with plenty of stops in national parks. In between, he started doing some tinkering.

The tinkering is a part-time gig: Most of Mullenweg’s time is spent as CEO of Automattic, one of the web’s largest platforms. It’s best known as the company that runs WordPress.com, the hosted version of the blogging platform that powers about 43% of the websites on the internet. Since WordPress is open-source software, no company technically owns it, but Automattic provides tools and services and oversees most of the WordPress-powered internet. It’s also the owner of the booming ecommerce platform WooCommerce, Day One, the analytics tool Parse.ly and the podcast app Pocket Casts. Oh, and Tumblr. And Simplenote. And many others. That makes Mullenweg one of the most powerful CEOs in tech, and one of the most important voices in the debate over the future of the internet.

Keep Reading Show less
David Pierce

David Pierce ( @pierce) is Protocol's editorial director. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.

Entertainment

Netflix looks to expand gaming with major IP deals, Fortnite-like updates

Remarks made to investors and recent job postings hint at big ambitions for Netflix’s nascent gaming efforts.

Netflix may be taking some cues from games like Fortnite and Apex: Legends for its own video game initiative.

Photo: Cameron Venti/Unsplash

Two months after launching mobile games to all of its members, Netflix is looking to double down on gaming: The company told investors Thursday that it wants to expand its portfolio of games “across both casual and core gaming genres.” Recent job offers suggest that this could include both live services games as well as an expansion to PC and console gaming, and the company's COO hinted at major licensing deals ahead.

Keep Reading Show less
Janko Roettgers

Janko Roettgers (@jank0) is a senior reporter at Protocol, reporting on the shifting power dynamics between tech, media, and entertainment, including the impact of new technologies. Previously, Janko was Variety's first-ever technology writer in San Francisco, where he covered big tech and emerging technologies. He has reported for Gigaom, Frankfurter Rundschau, Berliner Zeitung, and ORF, among others. He has written three books on consumer cord-cutting and online music and co-edited an anthology on internet subcultures. He lives with his family in Oakland.

Policy

Tim Cook, Ted Cruz and the strange politics of tech antitrust

Democrats and Republicans have found the tech reform debate scrambles traditional party politics — and the Apple CEO and Texas senator have found themselves chatting.

The Senate Judiciary Committee advanced a bill on Thursday that could remake the tech industry.

Photo: PartTime Portraits/Unsplash

Strange alliances formed ahead of Thursday's vote to advance a key antitrust bill to the Senate floor, with frequent foes like Sens. Amy Klobuchar and Ted Cruz supporting the measure, and prominent Democrats including California Sen. Dianne Feinstein pushing back against it.

Ultimately the bill moved out of the Senate Judiciary Committee by a vote of 16-6 after a surprisingly speedy debate (at least, speedy for the Senate). Even some of the lawmakers who called for further changes agreed to move the bill forward — a sign that the itch to finally regulate Big Tech after years of congressional inaction is intensifying, even as the issue scrambles traditional party politics in a way that could threaten its final passage.

Keep Reading Show less
Ben Brody

Ben Brody (@ BenBrodyDC) is a senior reporter at Protocol focusing on how Congress, courts and agencies affect the online world we live in. He formerly covered tech policy and lobbying (including antitrust, Section 230 and privacy) at Bloomberg News, where he previously reported on the influence industry, government ethics and the 2016 presidential election. Before that, Ben covered business news at CNNMoney and AdAge, and all manner of stories in and around New York. He still loves appearing on the New York news radio he grew up with.

Latest Stories
Bulletins