Enterprise

Working with the military is lucrative. For enterprise AI companies, it’s also a minefield.

C3.ai has made a concerted effort to take on military projects. Despite the risk of controversy, several other AI startups also recently joined the ranks of military tech providers; some say it's good for overall business.

Side view portrait of young African-American woman wearing military uniform inspecting server while working in server room.

When big tech companies have taken on defense industry work, it has spurred opposition from consumers and company employees.

Photo: SeventyFour via Getty Images

Enterprise tech companies often post customer logos on their websites as signals of their sales prowess, like service medals on a military uniform. But when AI tech vendors spotlight their work with defense industry customers, it’s not always considered a badge of honor.

As talk of war and national security intensifies in the wake of Russia’s invasion of Ukraine, the U.S. Department of Defense is on a mission to integrate data analytics and AI into every facet of its operations, from logistics to missile technology development. While some tech companies like C3.ai see providing AI software to the U.S. military as a way to help protect democratic values — and profit — to others, it just screams killer robots.

When asked last week during its Q3 2022 earnings call about how the company could assist the DoD and its allies in Ukraine, C3.ai CEO Thomas Siebel did not hesitate to highlight the opportunities for enterprise AI software companies.

“We are very actively engaged with the Department of the Army, the Department of the Air Force and with some of the intelligence agencies in some very large projects,” Siebel said.

Fast-tracking government AI purchases will be key to getting more of those projects, he said. Siebel pointed to modifications made in the 2022 National Defense Authorization Act that streamline procurement of tech from commercial AI companies by the Joint Artificial Intelligence Center, which leads integration of data- and AI-related work at the DoD.

“This change in federal procurement policy is very significant, basically mandating the Secretary of Defense put in procedures in place to ensure that commercial software is considered first,” Siebel said, referring to Defense Department work as “a big opportunity.” He added his company recently “achieved a new production deployment with the Defense Counterintelligence and Security Agency and secured additional business with the U.S. Space Force.”

C3.ai, which also works with customers in industries including health care, financial services and telecommunications, already has defense contracts in place. In 2020 it signed a deal with the DoD’s Defense Innovation Unit to help predict system failures and malfunctions, and optimize the performance of aircraft such as the E-3 Sentry, a plane used to surveil and assess situations on the ground during battle. The agreement allowed the DoD or other federal agencies to spend up to $95 million on the company’s technology for aircraft predictive maintenance.

But C3.ai’s software does not just help the military maintain its equipment. The company also works with the Missile Defense Agency, which uses its software to enable data integration, operations and security to simulate the performance of non-ballistic and hypersonic missiles.

“This solution can produce tens of thousands of missile trajectories in a matter of minutes — a 100-fold increase in model generation capacity and speed — enabling the Department to swiftly assess various operational scenarios, as needed, against adversarial missile systems,” wrote the DIU in a 2021 annual report. Alluding to missile technology advancements by China and Russia, the agency said it hoped to improve and accelerate DoD’s ability to simulate hypersonic missiles while in flight.

More recently in December 2021, the DoD awarded a five-year agreement to C3.ai, making it easier for defense customers to use up to $500 million worth of the company’s software without having to go through a formal bidding process.

Growing the ranks of AI tech draftees

C3.ai is just one of many tech companies joining the ranks of Pentagon AI suppliers.

Announced in February, up to $249 million of Joint Artificial Intelligence Center funds for AI testing and evaluation are now readily available to several AI tech providers including cloud AI companies DataRobot, Figure Eight Federal, Scale AI, Veritone, computer vision companies CrowdAI and Image Matters, and Arthur, which helps monitor AI models to avoid bias and inaccuracy.

“One of the ways to avoid the valley of death and one of the ways to get this technology into the warfighters’ hands is to be able to at least readily connect those vendors, those industry partners that have the technology, to the warfighter,” said Jane Pinelis, then-JAIC head of test and evaluation, at a 2021 event regarding a JAIC request for proposals to AI vendors.

The people in charge of the DoD haven’t always wanted to wait for rigorous testing of AI tech. “There’s a lot of conversation, I would say, somewhat erroneously, about test and evaluation delaying fielding,” said Pinelis, who is now chief of AI Assurance at JAIC, during a 2021 webinar, noting that test and evaluation of AI used by the DoD was traditionally thought of as “a hoop that somebody has to jump through before deployment.”

But she said attitudes within the DoD are shifting toward accepting the need to test and evaluate AI as a way to ensure that systems are more robust, and that by working with tech partners, the DoD can assess compliance with the ethical AI principles it established in 2020.

C3.ai targets the 'scholar-statesmen warriors' of the Pentagon

If recent additions to C3.ai’s board are any indication, its military presence is by design. Last year, the company added two former military leaders to its board, which was already home to former U.S. Secretary of State Condoleezza Rice. Retired Lieutenant General and former National Security Adviser H.R. McMaster and retired Lieutenant General Ed Cardon, who was also director of the U.S. Army Office of Business Transformation, both joined the company’s board.

In a 2019 Forbes interview, Siebel declared his admiration for people working at the Pentagon, calling them “scholar-statesmen warriors.”

He also referenced Vladimir Putin, recalling that the Russian president had once said, "Whoever wins the war in AI will be the ruler of the world.” Siebel continued, “I believe that is true, but I do not believe Russia will win. It is either going to be China or the U.S. I believe we are currently in a state of non-kinetic warfare with China."

Good for business?

Many of the AI vendors awarded JAIC contracts last month published press releases or blog posts celebrating them.

When AI tech suppliers tout their military work, “I’m pretty darn sure those companies think it’s good for business,” said Anthony Habayeb, CEO of Monitaur, which sells monitoring software to help ensure AI is fair and accurate, but has not engaged with the Defense Department. The company is focused on selling to insurance providers.

Habayeb said when tech vendors announce they are working with the federal government, other potential customers might think, “Working with the federal government is not easy, and if you got that done, you might be able to work with me.”

As AI companies seek military business, many also aim to appeal to more mainstream business decision-makers in other industries. Both C3.ai and Dataiku — which has also sought defense sector work — advertise to public radio listeners as providers of technology that helps everyday people solve business problems with AI (sometimes to the ire of prominent leaders in AI law and policy).


"We're focused on working with all sectors of the U.S. government, increasing scalability across agencies with technology that will upskill the federal workforce, provide trustworthy AI and enhance speed," said Mark Elszy, regional vice president of Federal at Dataiku. The company said it could not say whether it has done any work with the DoD.

“If you can help the federal government to be more fair in their use of AI, that’s pretty important,” Habayeb said, but added, “Serving the DoD is going to take a lot of resources and energy and focus, and if you’re doing that, how effectively can you serve other sectors?”

Working on AI-related military projects, though controversial, does not necessarily deter potential partners, either. Parity, a company that conducts audits of machine-learning algorithms to find and fix fairness and accuracy problems, is led by CEO Liz O’Sullivan. O’Sullivan co-founded Arthur — one of the companies awarded a recent JAIC contract — which she has since left.

While O’Sullivan said Parity currently has no plans to work with Arthur on defense contracts, Parity will partner with Arthur on non-defense work. “We remain open to working [in conjunction with Arthur] with any clients who are in our target markets of finance, insurance, health care and/or HR,” she said.

Killer robots and bad optics

Still, the mere mention of AI in relation to military work doesn’t sit well with some business leaders. “Our software doesn't have anything to do with killer robots. We use AI to scan invoices, not blow stuff up,” said the CTO of a software company that provides AI technologies who declined to comment on the record for this story.

When big tech companies have taken on defense industry work, it has spurred opposition from consumers and company employees. For instance, in 2018, Google employees protested the company’s Project Maven effort to develop drone AI technology with the military, prompting employee resignations.

Google dropped the project, which was reportedly taken over by data and AI tech provider Palantir. Palantir, which also works with companies in the energy, telco, media and financial services industries, reportedly won a $823 million contract last year from the U.S. Army.

“Reputational harm can be quite considerable” when AI tech providers work with the military, said Michael Connor, executive director of Open MIC, a nonprofit that has helped shareholders pressure tech companies including Microsoft and Amazon to establish ethical practices.

But these issues are complicated, Connor said. Because AI is used even for basic administrative purposes like automating invoices, it is important to consider DoD contracts with AI vendors on a case-by-case basis, he said.

“Just because you’re working with the defense industry doesn’t mean you’re doing something unethical,” Connor said. “It depends on what’s being used and when it’s being used. Context is critical.”

Workplace

An IPO may soon be in Notion’s future

Notion COO Akshay Kothari says there’s room to grow, aided by a new CFO who knows how to take a company public.

Notion has hired its first chief financial officer: Rama Katkar.

Photo: Courtesy of Notion

It’s been a year since Notion’s triumphant $275 million funding round and $10 billion valuation. Since then the landscape for productivity startups trying to make it on their own has completely changed, especially for those pandemic darlings that flourished in the all-remote world.

As recession looms, companies looking to cut costs are less likely to spend money on tools outside of their Microsoft or Google workplace bundles. Enterprise platforms are bulking up and it could spell trouble for the productivity startups trying to unseat them. But Notion COO Akshay Kothari says the company is still aiming to build the next Microsoft, not be the next Microsoft. And in a move signaling a new chapter of maturity, Notion has hired its first chief financial officer: Rama Katkar, Instacart’s former VP of finance.

Keep Reading Show less
Lizzy Lawrence

Lizzy Lawrence ( @LizzyLaw_) is a reporter at Protocol, covering tools and productivity in the workplace. She's a recent graduate of the University of Michigan, where she studied sociology and international studies. She served as editor in chief of The Michigan Daily, her school's independent newspaper. She's based in D.C., and can be reached at llawrence@protocol.com.

Sponsored Content

Great products are built on strong patents

Experts say robust intellectual property protection is essential to ensure the long-term R&D required to innovate and maintain America's technology leadership.

Every great tech product that you rely on each day, from the smartphone in your pocket to your music streaming service and navigational system in the car, shares one important thing: part of its innovative design is protected by intellectual property (IP) laws.

From 5G to artificial intelligence, IP protection offers a powerful incentive for researchers to create ground-breaking products, and governmental leaders say its protection is an essential part of maintaining US technology leadership. To quote Secretary of Commerce Gina Raimondo: "intellectual property protection is vital for American innovation and entrepreneurship.”

Keep Reading Show less
James Daly
James Daly has a deep knowledge of creating brand voice identity, including understanding various audiences and targeting messaging accordingly. He enjoys commissioning, editing, writing, and business development, particularly in launching new ventures and building passionate audiences. Daly has led teams large and small to multiple awards and quantifiable success through a strategy built on teamwork, passion, fact-checking, intelligence, analytics, and audience growth while meeting budget goals and production deadlines in fast-paced environments. Daly is the Editorial Director of 2030 Media and a contributor at Wired.
Securing the Enterprise

Securing the enterprise

There’s no let-up in the surge of cyberattacks against businesses. But shutting down the hackers will require many enterprises to evolve their strategy.

In today’s enterprise, “identity and security are very merged.”

Illustration: iStock/Getty Images Plus; Protocol
the Protocol team
Protocol focuses on the people, power and politics of tech, with no agenda and just one goal: to arm decision-makers in tech, business and public policy with the unbiased, fact-based news and analysis they need to navigate a world in rapid change.
Fintech

How neobanks are helping consumers game credit scoring

The CFPB says it is closely monitoring secured credit cards offered by neobanks.

Regulators are scrutinizing neobanks' card offerings.

Photo: Oscar Wong/Moment/Getty Images

About one in six Americans has a credit score below 619, according to the CFPB. Another 23% have too thin a credit file to score or no file at all. That puts them in a credit trap: To build credit, these consumers need someone to give them a line of credit with which they can demonstrate good financial habits. But with scores that low, few lenders are prepared to offer them anything.

Neobanks say they can solve the problem through a new twist on secured credit cards. But regulators are already scrutinizing their offerings.

Keep Reading Show less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

Policy

Steel decided World War II. Chips will decide whatever is next.

“Chip War: The Fight for the World’s Most Critical Technology” foreshadows the coming battle between nations over semiconductors.

“Chip War” outlines the nature of the coming battle over semiconductors, showing how the power to produce leading-edge chips fell into the hands of just five companies.

Image: Scribner; Protocol

“World War II was decided by steel and aluminum, and followed shortly thereafter by the Cold War, which was defined by atomic weapons,” Chris Miller, a professor at Tufts University’s Fletcher School of Law and Diplomacy, writes in the introduction to his latest book. So what’s next? According to Miller, the next era, including the rivalry between the U.S. and China, is all about computing power.

That tech rivalry and the story of how the chip industry got from four to 11.8 billion transistors are all part of Miller’s book, “Chip War: The Fight for the World’s Most Critical Technology,” which comes out Oct. 4. “Chip War” outlines the nature of the coming battle over semiconductors, showing how the power to produce leading-edge chips fell into the hands of just five companies: three from the U.S., one from Japan, and one from the Netherlands.

Keep Reading Show less
Hirsh Chitkara

Hirsh Chitkara ( @HirshChitkara) is a reporter at Protocol focused on the intersection of politics, technology and society. Before joining Protocol, he helped write a daily newsletter at Insider that covered all things Big Tech. He's based in New York and can be reached at hchitkara@protocol.com.

Latest Stories
Bulletins