A surveillance AI firm with hidden ties to China is seeking US infrastructure contracts

Remark Holdings, whose AI-based surveillance technologies have deep but mostly hidden ties to China, already has a partnership with a Florida high-speed rail provider. Now, the company wants to pursue additional U.S. infrastructure projects.

HOUSTON, TEXAS - JULY 29: A railway is shown at the Port of Houston on July 29, 2021 in Houston, Texas. The Port of Houston has halted operations at two of its container terminals after a reported failure of computer devices. The Port of Houston is one of the world's largest ports on the Gulf Coast and ranks 6th overall for containers held. The shutdown in Houston is another strain contributing to pandemic-related disruptions as a recent surge in consumer goods has increased due to much of the countries phased reopening. (Photo by Brandon Bell/Getty Images)

CEO Kai-Shing Tao wants Remark to provide its software to U.S. states and municipalities through infrastructure projects funded by the U.S. government.

Photo: Brandon Bell/Getty Images

When he posed for a photo with Texas Governor Greg Abbott, Kai-Shing Tao wore a bright red polo shirt. He flashed a grin for another shot with Chicago Mayor Lori Lightfoot. Tao’s China-linked AI company, Remark Holdings, tweeted the images in March with captions littered with hashtags like #BorderCrisis, #Transit and #PublicSafety. The photos may have been signs to weary investors that Remark Holdings was making progress in its efforts to score U.S. government projects.

Tao is chairman and CEO of Remark Holdings, a company whose AI-based surveillance and security technologies have deep — yet mostly hidden — ties to China. Remark, which sells its AI systems for public safety purposes in transportation hubs, on school campuses and in retail stores, already has a partnership with Florida high-speed rail provider Brightline. The companies said in November that the private rail service will use Remark’s cameras and “smart safety” computer vision and analytics system to detect pedestrians or out-of-the-ordinary objects along a 67-mile stretch of railroad from Miami to West Palm Beach, Florida.

Now, Tao says he wants Remark to provide its software, which includes facial and object recognition, to U.S. states and municipalities through infrastructure projects funded by the U.S. government. But China tech and policy experts say the company is traveling in dangerous territory, and they warn that U.S. lawmakers and regulators could stop Remark in its tracks.

Remark has morphed from its original incarnation as a digital media company with links to TV celebrities Dr. Mehmet Oz and Oprah Winfrey. Now pushing a safety and security agenda powered by AI, the company reported to the SEC in March that its U.S. AI business “purchased substantially all” of its inventory and equipment from an unnamed China business partner.

Remark says its proprietary data and AI software platform was co-developed with one of its China subsidiaries, although the company appears to have computer engineers based in the U.S. and U.K. according to a LinkedIn search of its employees.

Florida Sen. Marco Rubio, a vocal critic of the Chinese Communist Party and its support for AI and emerging tech development, signaled disapproval of the use of tech originating in China for U.S. critical infrastructure such as train lines. When asked to comment on Brightline’s partnership with Remark for this story, he told Protocol, "The Chinese Communist Party is devoting significant resources to firms willing to help them develop the most invasive surveillance state in the world. Those same firms should not be allowed anywhere near critical infrastructure in America.” A private rail line such as Brightline’s is critical infrastructure, he said.

However, without clarification on who actually built Remark’s AI systems, where its equipment comes from and its data use and security practices, observers will be forced to speculate, and distinguishing between real and perceived risks will be difficult.

It is not known whether the state of Texas, the city of Chicago or any other U.S. governments have signed deals with Remark. Remark Holdings has not responded to multiple inquiries to comment for this story. Neither Governor Abbott’s office nor Mayor Lightfoot’s office have responded to requests to comment.

The software is going to get used on a railway. You are opening up your IT systems to a certain extent. That’s a cybersecurity risk.

In reference to the Brightline partnership, Xiaomeng Lu, director of the geo-technology practice at advisory firm Eurasia Group, said, “The software is going to get used on a railway. You are opening up your IT systems to a certain extent. That’s a cybersecurity risk.”

“There are lawmakers on Capitol Hill who will point to a case like [the Remark-Brightline partnership] and say, ‘What if they are collaborating with the PLA?’” Lu continued, referring to China’s military force, The People's Liberation Army.

However, comprehensive data protection laws could reduce the risk of U.S. citizen data or infrastructure data ending up on servers in China where it could be accessed by the Chinese government, said Paul Triolo, senior vice president for China and technology policy lead at advisory firm Albright Stonebridge Group.

“The lack of a comprehensive U.S. data protection law is hampering efforts to come up with workable approaches to ensuring that potentially sensitive U.S. data can be protected when companies are operating across jurisdictions, particularly between the U.S. and China,” Triolo said.

American-made rail

“Our trains are American-made and we're 100% Buy American-compliant,” states Brightline on its website, which describes its high-speed train experience as “a safe, fun, and welcoming ride for everyone aboard.”

When Brightline and Remark announced their decision to work together, the companies said Brightline would use Remark’s AI-powered cameras and software, which uses computer vision to detect intrusions and monitor for anomalies on tracks and in railyards. The Remark system alerts personnel when people or vehicles cross railways or enter tracks as a train approaches.

“One of the biggest reasons we decided to go forward with this partnership is Brightline is implementing a lot of safety throughout the corridor,” Vanessa Alfonso, director of Media Relations at Brightline, told Protocol in April. Although she could not provide details on what types of equipment from Remark would be installed, Alfonso said, “It would definitely monitor any type of unusual behavior that would happen around the railroad tracks.”

Remark has noted in SEC filings that its “Smart Sentry” railway security software was developed in conjunction with one of its subsidiaries, many of which are based in China. The company wants the system to be used in train stations in China and is “bidding for the 40 train stations to use our platform” there, Tao said during Remark’s quarterly earnings call this month. Remark also markets its AI systems for railways and transportation hubs in the U.K.

“The challenge here that we are meeting is having the ability to discern who is potentially entering the track. Our system needs to identify the difference between the staffs. If it's a railway worker, security staff, maintenance and/or cleaning individual versus actual passengers,” Tao said during the call.

It is unclear whether Brightline will use Remark’s facial recognition technology to identify people. When Protocol spoke with Alfonso, she said the two companies were still testing Remark’s system. “We probably don’t have that all nailed down yet,” she said.

Since the April interview with Alfonso, however, Brightline has not responded to multiple subsequent inquiries seeking more information.

Geopolitical and human rights concerns

When asked why Brightline chose to work with Remark, Alfonso said, “Our safety and security team has done quite a bit to find the right partners and invest in technology.”

Although partnerships between U.S. and Chinese tech companies and academic researchers continue, geopolitical forces are deterring collaboration in sectors of strategic importance such as AI and transportation infrastructure. President Joseph Biden launched a new Indo-Pacific Economic Framework on Monday while on a tour in Asia to bolster alliances in the region in part to counteract China’s sphere of influence.

“[Brightline] maybe doesn’t have the strongest awareness of the geopolitical environment they are operating in,” Lu said.

U.S. legislators and human rights advocates have pushed to ban the use of facial recognition to surveil people in the U.S. There are also bipartisan condemnations of facial recognition use by Chinese authorities to monitor and detain the ethnic minority Uyghur Muslim population in the northwest China region of Xinjiang.

Remark’s Chinese website mentions its involvement in an “Intelligent Safe Residential Area” project in Ningbo, China, which employs the KanKan AI facial recognition technology. The project appears to be “part of the [Chinese] government’s blanket video-surveillance program, Sharp Eyes,” said Rebecca Arcesati, a China tech analyst at think tank MERICS.

“These kinds of programs purport to protect public safety, but in the Chinese context preserving social stability implies keeping tabs on a wide range of acts — from traffic violations to political dissent,” she said.

In general, Arcesati said companies partnering with Remark should consider the implications of its other surveillance projects. “Even though I have not seen any evidence that [Remark’s] China operations have been involved in human rights abuses so far, its partners will want to keep a close eye on its public surveillance business, or else they might face serious reputational risks,” Arcesati said.

“This task is even more important for contracting authorities having to choose vendors in the context of publicly funded infrastructure projects.”

Project Dragon and a shell company labyrinth

Remark didn’t always sell AI-based surveillance tech. In fact, the company was 8 years old when it first began dabbling in AI through a social media app it planned for launch in China in 2014 referred to by the code name “Project Dragon.” Project Dragon eventually became known as “Project Kankan.” By 2015, while still calling itself Remark Media, the company that would later become Remark Holdings said it had begun beta testing the app it branded KanKan with “a small number of Chinese users.”

A few years later in 2020, the company — now Remark Holdings — said its KanKan AI technology had made its way into an “AI-driven pharmacy-patient terminal system” installed in thousands of pharmacies in Chinese cities, and a “taxi safety monitoring system” used in more than 2,000 taxis in the Chinese city of Xi’an. KanKan, which the company was now calling a “data intelligence platform,” would serve as a foundation for new AI-based products and services to be sold in the Asia market, it said.

Remark Media was born in 2006 as a wholly owned subsidiary of HowStuffWorks designed to develop businesses for markets in China and Brazil using HSW’s content. In 2009 it co-founded a U.S.-based health media company called ShareCare along with TV celebrity and Republican candidate for the Pennsylvania Senate, Dr. Mehmet Oz, Discovery Communications and HARPO Productions, producer of “The Oprah Winfrey Show.”

Remark Holdings, whose public ticker symbol is MARK, uses a Russian doll-like organizational structure to operate its China and U.S. businesses. Its Cayman Islands-based KanKan Holdings subsidiary owns Hong Kong-based KanKan Limited, which in turn owns Shanghai’s KanKan Technology. Remark owns 100% of the equity of a wholly foreign-owned enterprise that has contractual arrangements with variable interest entities or VIEs; those VIEs are owned by members of Remark’s management team in China and third parties.

“We use the VIE structure to address challenges resulting from laws, policies and practices that may disfavor foreign-owned entities that operate within industries deemed sensitive by the Chinese government,” noted Remark in a public filing. The company also states, “We are a holding company incorporated in Delaware and not a Chinese operating company.”

“This is a really murky gray area,” said Alex Capri, a researcher and consultant studying tech trade flows and competition who teaches at the National University of Singapore Business School. “Holding companies or shell companies could be set up to divert attention away from the actual end use or end user.”

Plus, Remark’s complex business structure reflects a trade-related imbalance, said Capri. “Here we have Chinese entities or companies that have established legal entities in China that are in fact participating in critical infrastructure building in the United States, and you don’t see these barriers to entry to specific sectors in the United States as well defined and as numerous [and] as clearly articulated in statutes as you do in China,” Capri said.

“It’s not a level playing field. There’s this ongoing, nagging issue that this access to the market is not reciprocal,” he added.

Financially, Remark has admitted its business is suffering. The company said in March that, according to its independent accounting firm, “there is substantial doubt about our ability to continue as a going concern.”

The company said it has incurred net losses and generated negative cash flow from operations resulting in an accumulated deficit of $333 million. In fact, Remark reported in March that it has $11.5 million in accounts receivable from customers in China, of which $2.6 million are past due.

Not only was the company sued in 2020 for failing to pay rent on its U.S. headquarters offices in Las Vegas, Nevada (the suit has since been dismissed), Remark’s employee count dropped significantly from 290 full-time employees in 2019 to just 74 full-time employees in March 2022.

Seeing dollar signs in U.S. Infrastructure Act projects

Despite the potential political scrutiny, Tao has been transparent about his mission to participate in federally funded infrastructure projects. “We have now increased our efforts to major cities like New York City and Chicago, and states like Texas, Nevada, California, Florida and New Jersey. A big part of this increased effort is due to the demand we are seeing from both government and private business post Infrastructure Bill,” Tao said in March.

Tao emphasized Remark’s experience operating AI-based safety and surveillance systems in China. “Simply put, the opportunities and funding allocated in the infrastructure bill here are massive, and we could have not written a better bill to reflect our core competencies and products to pursue and capture the specific growth markets allocated by the bill,” he said in November on the day the Infrastructure Investment and Jobs Act was signed into law.

“Our ability to bring our proven AI platform to the U.S. from Asia has given us the leading opportunity to capture this business where technology helps augment the effectiveness of the infrastructure bill.”

This story was updated to clarify a quote from Rebecca Arcesati.


Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep ReadingShow less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep ReadingShow less
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep ReadingShow less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep ReadingShow less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.


Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep ReadingShow less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories