Policy

How Axon's plans for Taser drones blindsided its AI ethics board

“It scares the living daylights out of a lot of us.”

Axon Taser drone

Axon’s decision to ignore its own handpicked panel of experts’ explicit guidance is an object lesson on the shortcomings of tech companies’ own ethical AI efforts.

Image: Axon

Late Tuesday night, NYU law professor Barry Friedman called an emergency Zoom meeting with members of the AI ethics board for Taser-maker Axon.

Just a few weeks before, the board — which includes academics, civil liberties advocates and two former chiefs of police — had voted against a proposal by Axon to develop Taser-equipped drones and run a limited pilot program with law enforcement. The board had been mulling the possibility of such a pilot for about a year, according to Friedman; ultimately, a majority of the board decided the risks outweighed the benefits.

But on Tuesday, an email landed in Friedman’s inbox from an Axon employee, alerting him that the company was forging ahead with the plan anyway. Not only was Axon going to develop Taser drones, it planned to pitch them as an answer to school shootings, in the wake of the Uvalde tragedy.

The board had about 48 hours to respond. “This came out of the blue,” Friedman said.

“We were told and given two days to react to something very different than something that we had reacted to. And we already said no to it,” said Danielle Citron, a law professor at University of Virginia who is also a member of the board. “It scares the living daylights out of a lot of us.”

Friedman scrambled to organize the board’s response and “repeatedly” pushed the company not to go forward, he said.

On Thursday morning, Axon CEO Rick Smith announced his company’s intention to develop Taser drones anyway, sharing a press release in which the board’s earlier opposition was buried about 1,200 words deep. Hours later, after receiving a wave of negative responses, Axon tweeted the board’s full response roundly condemning the decision, which the board submitted after Axon’s public announcement.

In a statement to Protocol, Smith said, “I understand and agree with the board’s concerns that there are many questions we will need to answer to ensure these systems are designed for maximum safety and with equity in mind. That’s the exact reason why I decided to go public: to broaden the discussion with many stakeholders.”

Smith encouraged concerned citizens and lawmakers to engage with the company through the development process, including during a Reddit ask me anything session on Friday. “I want to hear from legislators, public safety leaders, school administrators, and parents and members of the concerned public,” Smith wrote.

But whether the board’s members will stay on to have those discussions remains an open question. Some members are now actively considering whether working with the company is still worth their time. “In the past, we were helpful and listened to and [our] feedback was relevant, and maybe not so much anymore,” Citron said. “Maybe this was a period of time, and it’s not meant to be forever.”

“We’re all having conversations about that,” Friedman said.

Axon’s decision to ignore its own handpicked panel of experts’ explicit guidance is an object lesson on the shortcomings of tech companies’ own ethical AI efforts. Short of regulation or laws governing the use of AI and other forms of surveillance, even the most accomplished advisers ultimately only have so much power to push back against companies’ competing priorities.

In a video explaining the company’s decision, Smith attributed it to the horrors of the Uvalde, Texas, shooting, which left 19 children and two teachers dead and 17 others wounded. “When I heard about the latest shooting in an elementary school, I held my kids and my wife, and we cried. That could have been us. It’s so frustrating this just keeps happening,” he said. “So, I’m done waiting for politicians to solve this problem, and we’re going to solve it.”

He described Taser-equipped drones as part of a “three-point plan” to address the scourge of school shootings. That plan also includes sharing footage from cameras in schools with first responders and building VR active shooter training for law enforcement. (In Uvalde, police took part in active shooter training just months before the rampage.)

During his AMA, Smith rejected the idea that Axon is pitching this product as a way to profit from tragedy. “Frankly, there are much easier ways to make money than solving intractable problems like this,” he wrote. “We are engaged out of a passionate belief that we can make technology that is safer, more ethical, and more controlled than today’s solution of adding more people with more guns.”

Citron said she and others had joined Axon’s ethics board because they believed Smith’s ultimate goal is to cut down on shootings with less lethal technology than guns. “I really actually believe him. His end goal is less death by bullets,” Citron said.

And members of the board felt they were making headway in guiding the company’s stance on AI issues, she said, including its commitment not to use facial recognition in body cameras. “That they were interested in hearing our opinions about the kinds of legal imprimatur they should support was gratifying,” Citron said.

It’s been clear to Citron and others, however, that the board’s authorities were limited. That’s by design, Smith said in his AMA. “The purpose of this board is to bring in police-skeptical view points, and our company makes tools for police,” he wrote. “If the board has governing rights over the company, then we would have to make sure the board had a stronger balance of pro-public safety views … which would undermine the very reason for having this advisory board.”

Smith noted that the former police chiefs on the board did support the drone proposal, and he emphasized that the concept is still in the idea phase, not the product phase. “The ethics board will have a say in this decision,” Smith wrote.

But Axon’s dismissal of the majority’s recommendations regarding drones has shaken members’ faith in the board’s overall purpose. Despite their objections, Axon decided to develop this technology not for law enforcement, but for an entirely different and unvetted context: schools. “It’s going to fall on the shoulders of marginalized kids, without question, and couple that with a drone with Taser in a classroom that a kid could hack?” Citron said. “It boggles the mind.”

Every day, millions of us press the “order” button on our favorite coffee mobile application. When we arrive at the coffee shop, we expect that our chosen brew will be on the counter a few minutes later. It’s a personalized, seamless experience that we have all come to expect. What we don’t know is what’s happening behind the scenes. The mobile application is sourcing data from a database that stores information about each customer and what their favorite coffee drinks are. It is also leveraging event-streaming data in real time to ensure the ingredients for your personal coffee are in supply at your local store.

Applications like this power our daily lives, and if they can’t access massive amounts of data stored in a database as well as streaming data “in motion” instantaneously, you, and millions of customers, won’t have the in-the-moment experiences we all expect.

Keep Reading Show less
Jennifer Goforth Gregory
Jennifer Goforth Gregory has worked in the B2B technology industry for over 20 years. As a freelance writer she writes for top technology brands, including IBM, HPE, Adobe, AT&T, Verizon, Epson, Oracle, Intel and Square. She specializes in a wide range of technology, such as AI, IoT, cloud, cybersecurity, and CX. Jennifer also wrote a bestselling book The Freelance Content Marketing Writer to help other writers launch a high earning freelance business.
Policy

How the internet got privatized and how the government could fix it

Author Ben Tarnoff discusses municipal broadband, Web3 and why closing the “digital divide” isn’t enough.

The Biden administration’s Internet for All initiative, which kicked off in May, will roll out grant programs to expand and improve broadband infrastructure, teach digital skills and improve internet access for “everyone in America by the end of the decade.”

Decisions about who is eligible for these grants will be made based on the Federal Communications Commission’s broken, outdated and incorrect broadband maps — maps the FCC plans to update only after funding has been allocated. Inaccurate broadband maps are just one of many barriers to getting everyone in the country successfully online. Internet service providers that use government funds to connect rural and low-income areas have historically provided those regions with slow speeds and poor service, forcing community residents to find reliable internet outside of their homes.

Keep Reading Show less
Aditi Mukund
Aditi Mukund is Protocol’s Data Analyst. Prior to joining Protocol, she was an analyst at The Daily Beast and NPR where she wrangled data into actionable insights for editorial, audience, commerce, subscription, and product teams. She holds a B.S in Cognitive Science, Human Computer Interaction from The University of California, San Diego.
Fintech

How I decided to exit my startup’s original business

Bluevine got its start in factoring invoices for small businesses. CEO Eyal Lifshitz explains why it dropped that business in favor of “end-to-end banking.”

"[I]t was a realization that we can't be successful at both at the same time: You've got to choose."

Photo: Bluevine

Click banner image for more How I decided series

Bluevine got its start in fintech by offering a modern version of invoice factoring, the centuries-old practice where businesses sell off their accounts receivable for up-front cash. It’s raised $767 million in venture capital since its founding in 2013 by serving small businesses. But along the way, it realized it was better to focus on the checking accounts and lines of credit it provided customers than its original product. It now manages some $500 million in checking-account deposits.

Keep Reading Show less
Ryan Deffenbaugh
Ryan Deffenbaugh is a reporter at Protocol focused on fintech. Before joining Protocol, he reported on New York's technology industry for Crain's New York Business. He is based in New York and can be reached at rdeffenbaugh@protocol.com.
Enterprise

The Roe decision could change how advertisers use location data

Over the years, the digital ad industry has been resistant to restricting use of location data. But that may be changing.

Over the years, the digital ad industry has been resistant to restrictions on the use of location data. But that may be changing.

Illustration: Christopher T. Fong/Protocol

When the Supreme Court overturned Roe v. Wade on Friday, the likelihood for location data to be used against people suddenly shifted from a mostly hypothetical scenario to a realistic threat. Although location data has a variety of purposes — from helping municipalities assess how people move around cities to giving reliable driving directions — it’s the voracious appetite of digital advertisers for location information that has fueled the creation and growth of a sector selling data showing who visited specific points on the map, when, what places they came from and where they went afterwards.

Over the years, the digital ad industry has been resistant to restrictions on the use of location data. But that may be changing. The overturning of Roe not only puts the wide availability of location data for advertising in the spotlight, it could serve as a turning point compelling the digital ad industry to take action to limit data associated with sensitive places before the government does.

Keep Reading Show less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories
Bulletins