Enterprise

Andrew Ng thinks your company is doing AI wrong

The former head of Google Brain says organizations should start smaller, not larger.

Andrew Ng of Landing.ai speaks at an Amazon event in 2019.

Andrew Ng of Landing.ai speaks at an Amazon event in 2019.

Photo: Mark Ralston/AFP/Getty Images

Andrew Ng knows a thing or two about artificial intelligence.

The former head of Google Brain and prior chief scientist at Baidu, Ng also co-founded Coursera and regularly teaches popular courses on the technology online and at Stanford. And he runs Landing AI, which provides manufacturers (and soon, other industries) with an AI platform to help developers more easily build and deploy computer vision models.

That experience has given Ng a deep understanding of the benefits that AI can produce — and the limitations of the tech. As Ng expands his work outside of consumer internet companies, he's seeing a pattern: Organizations are setting their AI ambitions too high.

"I still see companies jump in and make investments in projects that I would consider technically impossible or technically not feasible with today's technology or the near-term generations of technology," he told Protocol. "Learn to walk first. It's fine that the first project you do is not a $10 million AI project."

But even landing on a smaller project can be difficult due to the nature of AI initiatives, which often span departments and require cross-functional leadership that many organizations are still working to develop. It's why Ng says a central AI group is so paramount.

"That'll take some top-down leadership to put in place," he said.

Protocol talked to Ng to learn what he thinks enterprises are getting wrong about their AI strategy and why investments in MLOps should be the wave of the future.

This interview has been edited for brevity and clarity.

As we see the excitement around AI continue to grow, where do you think the broader market is? Is the tech more hype than reality at this point?

AI isn't one monolithic thing. So there are some segments where the hype is definitely disproportionate, but also some segments where there's a lot that's not as visible to the wider public. [Artificial general intelligence] still has a little bit too much hype, though it's come down a little bit. On the flip side, there's a lot of industrial, B2B applications of AI that are valuable but not as well understood compared to a B2C application, which is much more relatable.

Where would you say enterprises are at in this journey? I know there'll be differences, but it seems companies are now starting to take what were smaller pilot projects and expand those.

Very early. For the large companies, even the Fortune 500, some are further ahead but many have one AI project that was put into production through sheer heroics that is reaping substantial amounts of value and potentially dozens of pilot projects that could be promising but, at least on the current path, may take heroics again to put into production. The more traditional industries, where the digitization wave came a little bit later, are still very early.

You've been vocal about the need for quality data over investments in models. Are there sources of data that companies are ignoring?

I feel like the answer has got to be yes. The more common pattern is there are a lot of companies with data sitting around that [is] already good enough to create tremendous value. All data they can very easily create. Take ecommerce. Tons of companies have tons of user data already sitting in their data warehouse and an AI team would be able to go in and drive insights.

What is the best way for organizations to begin this AI journey? How do they have to be set up to be successful?

One of the most important steps is to deliver a quick win. Small pilot project and then take it to a successful outcome. And that initial quick win often teaches an organization lessons that would then be useful for the second, third and fourth projects. Too many companies start off wanting a grand plan. But until it's learned to walk, it's very difficult to plan out what to do when you cross the finish line of the marathon. Learn to walk first. It's fine that the first project you do is not a $10 million AI project. It's fine that the first project you do is a $200,000 project — or even a $50,000 project. The purpose of that is not necessarily to create massive ROI. The greater value is the learning.

Are there any other ways companies are getting their AI strategy wrong?

One of the challenges of AI is it takes a decent amount of technical knowledge to figure out what is and isn't technically feasible. I still see companies jump in and make investments in projects that I would consider technically impossible or technically not feasible with today's technology or the near-term generations of technology.

For example, building a chatbot that can handle all customer service requests in a fairly conversant way. It's clear that's not possible. Fairly recently, someone asked if I could help them build the equivalent of a self-driving car with six engineers in six months. I don't think I could do that.

Project selection is still really difficult, because it takes cross-functional business and technical judgement to prioritize projects. Only a centralized AI group can build horizontal platforms that span the entire company, so that'll take some top-down leadership to put in place.

What did you see in the manufacturing industry specifically that made you start Landing AI?

Speaking with a lot of C-suites about AI adoption, [I] saw many of the same problems over and over in terms of practical deployment. There are lots of $1 [million] to $3 million projects. And it's challenging to get the AI talent and the staffing to make the economics workout. Tons of projects were stuck in proof of concept, because even if a company developed an AI model, it's difficult to write all surrounding software — MLOps is sometimes what we call that — to take that system into production.

We ended up building LandingLens, which is a data-centric, MLOps platform for computer vision. We help companies — starting in manufacturing but we have interest in other computer vision vertical applications — be 10x more efficient and often much more successful as well in building and deploying computer vision systems.

It seems the prevailing notion for why companies adopt AI is to cut costs. Do you find that, based on where we are at in the life cycle of AI, that immediate outcomes should be around quality improvement? Does it make a difference in terms of success which metrics prioritize first?

Cutting cost is a worthy thing to do and improving revenues or improving margins is a worthy thing to do, but I find that the latter category of projects often has more momentum than just cost-cutting. It's easy to get momentum on projects that create value beyond cutting costs.

What would be your one piece of advice for enterprises struggling with their AI strategy?

Find the right philosophies and MLOps tooling, because that will give organizations a big boost in AI adoption and performance. We've moved past the era where it's about the engineer using their own tools. Until now, a lot of AI was developed using very broad tools. We did that for the past decade, we're now moving on. I don't write any code in assembly myself. In the future, we'll find that the tooling will make machine learning engineers much more efficient.

Entertainment

The (gaming) clones never stopped attacking

Clones keep getting through app review despite App Store rules about copying. It's a sign of the weaknesses in mobile app stores — and the weakness in Big Tech’s after-the-fact moderation approach.

Clones aren't always illegal, but they are widely despised.

Image: Disney

Two of the most fundamental tenets of the mobile gaming market:

  1. Free always wins.
  2. No good gaming idea is safe from copycats.

In combination, these two rules help produce what the industry calls a clone. Most often, clones are low-effort, ripped-off versions of popular games that monetize in not-so-savory fashion while drawing in players with a price tag of zero.

Keep Reading Show less
Nick Statt
Nick Statt is Protocol's video game reporter. Prior to joining Protocol, he was news editor at The Verge covering the gaming industry, mobile apps and antitrust out of San Francisco, in addition to managing coverage of Silicon Valley tech giants and startups. He now resides in Rochester, New York, home of the garbage plate and, completely coincidentally, the World Video Game Hall of Fame. He can be reached at nstatt@protocol.com.
Sponsored Content

A CCO’s viewpoint on top enterprise priorities in 2022

The 2022 non-predictions guide to what your enterprise is working on starting this week

As Honeywell’s global chief commercial officer, I am privileged to have the vantage point of seeing the demands, challenges and dynamics that customers across the many sectors we cater to are experiencing and sharing.

This past year has brought upon all businesses and enterprises an unparalleled change and challenge. This was the case at Honeywell, for example, a company with a legacy in innovation and technology for over a century. When I joined the company just months before the pandemic hit we were already in the midst of an intense transformation under the leadership of CEO Darius Adamczyk. This transformation spanned our portfolio and business units. We were already actively working on products and solutions in advanced phases of rollouts that the world has shown a need and demand for pre-pandemic. Those included solutions in edge intelligence, remote operations, quantum computing, warehouse automation, building technologies, safety and health monitoring and of course ESG and climate tech which was based on our exceptional success over the previous decade.

Keep Reading Show less
Jeff Kimbell
Jeff Kimbell is Senior Vice President and Chief Commercial Officer at Honeywell. In this role, he has broad responsibilities to drive organic growth by enhancing global sales and marketing capabilities. Jeff has nearly three decades of leadership experience. Prior to joining Honeywell in 2019, Jeff served as a Partner in the Transformation Practice at McKinsey & Company, where he worked with companies facing operational and financial challenges and undergoing “good to great” transformations. Before that, he was an Operating Partner at Silver Lake Partners, a global leader in technology and held a similar position at Cerberus Capital LP. Jeff started his career as a Manufacturing Team Manager and Engineering Project Manager at Procter & Gamble before becoming a strategy consultant at Bain & Company and holding executive roles at Dell EMC and Transamerica Corporation. Jeff earned a B.S. in electrical engineering at Kansas State University and an M.B.A. at Dartmouth College.
Entertainment

Beat Saber, Bored Apes and more: What to do this weekend

Don't know what to do this weekend? We've got you covered.

Images: Ross Belot/Flickr; IGBD; BAYC

This week we’re listening to “Harvest Moon” on repeat; burning some calories playing Beat Saber; and learning all about the artist behind the goofy ape pics that everyone (including Gwyneth Paltrow?) is talking about.

Neil Young: Off Spotify? No problem.

Neil Young removed his music from Spotify this week, but countless recordings are still available on YouTube, including this 1971 video of him performing “Heart of Gold” in front of a live studio audience, complete with some charming impromptu banter. And while you’re there, scroll down and read a few of the top-rated comments. I promise you won’t be disappointed.

'Archive 81': Not based on a book, but on a podcast!

Netflix’s latest hit show is a supernatural mystery horror mini-series, and I have to admit that I was on the fence about it many times, in part because the plot just often didn’t add up. But then the main character, Dan the film buff and archivist, would put on his gloves, get in the zone, and meticulously restore a severely damaged, decades old video tape, and proceed to look for some meaning beyond the images. That ritual, and the sentiment that we produce, consume and collect media for something more than meets the eye, ultimately saved the show, despite some shortcomings.

'Secrets of Sulphur Springs': Season 2 is out now

If you’re looking for a mystery that's a little more family-friendly, give this show about a haunted hotel, time travel, and kids growing up in a world that their parents don’t fully understand a try. Season 2 dropped on Disney+ this month, and it not only includes a lot more time travel mysteries, but even uses the show’s time machine to tackle subjects as serious as reparations.

The artist behind those Bored Apes

Remember how NFTs are supposed to generate royalties with every resale, and thus support artists better than any of their existing revenue streams? Seneca, the artist who was instrumental in creating those iconic apes for the Bored Ape Yacht Club, wasn’t able to share details about her compensation in this Rolling Stone profile, but it sure sounds like she is not getting her fair share.

Beat Saber: Update incoming

Years later, Beat Saber remains my favorite VR game, which is why I was very excited to see a teaser video for cascading blocks, which could be arriving any day now. Time to bust out the Quest for some practice time this weekend!

Correction: Story has been updated to correct the spelling of Gwyneth Paltrow's name. This story was updated Jan. 28, 2022.


Janko Roettgers

Janko Roettgers (@jank0) is a senior reporter at Protocol, reporting on the shifting power dynamics between tech, media, and entertainment, including the impact of new technologies. Previously, Janko was Variety's first-ever technology writer in San Francisco, where he covered big tech and emerging technologies. He has reported for Gigaom, Frankfurter Rundschau, Berliner Zeitung, and ORF, among others. He has written three books on consumer cord-cutting and online music and co-edited an anthology on internet subcultures. He lives with his family in Oakland.

Boost 2

Can Matt Mullenweg save the internet?

He's turning Automattic into a different kind of tech giant. But can he take on the trillion-dollar walled gardens and give the internet back to the people?

Matt Mullenweg, CEO of Automattic and founder of WordPress, poses for Protocol at his home in Houston, Texas.
Photo: Arturo Olmos for Protocol

In the early days of the pandemic, Matt Mullenweg didn't move to a compound in Hawaii, bug out to a bunker in New Zealand or head to Miami and start shilling for crypto. No, in the early days of the pandemic, Mullenweg bought an RV. He drove it all over the country, bouncing between Houston and San Francisco and Jackson Hole with plenty of stops in national parks. In between, he started doing some tinkering.

The tinkering is a part-time gig: Most of Mullenweg’s time is spent as CEO of Automattic, one of the web’s largest platforms. It’s best known as the company that runs WordPress.com, the hosted version of the blogging platform that powers about 43% of the websites on the internet. Since WordPress is open-source software, no company technically owns it, but Automattic provides tools and services and oversees most of the WordPress-powered internet. It’s also the owner of the booming ecommerce platform WooCommerce, Day One, the analytics tool Parse.ly and the podcast app Pocket Casts. Oh, and Tumblr. And Simplenote. And many others. That makes Mullenweg one of the most powerful CEOs in tech, and one of the most important voices in the debate over the future of the internet.

Keep Reading Show less
David Pierce

David Pierce ( @pierce) is Protocol's editorial director. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.

Workplace

Mental health at work is still taboo. Here's how to make it easier.

Tech leaders, HR experts and organizational psychologists share tips for how to destigmatize mental health at work.

How to de-stigmatize mental health at work, according to experts.

Illustration: Christopher T. Fong/Protocol

When the pandemic started, HR software startup Phenom knew that its employees were going to need mental health support. So it started offering a meditation program, as well as a counselor available for therapy sessions.

To Chief People Officer Brad Goldoor’s surprise, utilization of these benefits was very low, starting at about a 10% take rate and eventually weaning off. His diagnosis: People still aren’t fully comfortable opening up about mental health, and they’re especially not comfortable engaging with their employer on the topic.

Keep Reading Show less
Michelle Ma

Michelle Ma (@himichellema) is a reporter at Protocol, where she writes about management, leadership and workplace issues in tech. Previously, she was a news editor of live journalism and special coverage for The Wall Street Journal. Prior to that, she worked as a staff writer at Wirecutter. She can be reached at mma@protocol.com.

Fintech

Robinhood's regulatory troubles are just the tip of the iceberg

It’s easiest to blame Robinhood’s troubles on regulatory fallout, but its those troubles have obscured the larger issue: The company lacks an enduring competitive edge.

A crypto comeback might go a long way to help Robinhood’s revenue

Image: Olena Panasovska / Alex Muravev / Protocol

It’s been a full year since Robinhood weathered the memestock storm, and the company is now in much worse shape than many of us would have guessed back in January 2021. After announcing its Q4 earnings last night, Robinhood’s stock plunged into the single digits — just below $10 — down from a recent high of $70 in August 2021. That means Robinhood’s valuation dropped more than 84% in less than six months.

Investor confidence won’t be bolstered much by yesterday’s earnings results. Total net revenues dropped to $363 million from $365 million in the preceding quarter. In the quarter before that, Robinhood reported a much better $565 million in net revenue. Net losses were bad but not quite as bad as before: Robinhood reported a $423 million net loss in Q4, an improvement from the $1.3 billion net loss in Q3 2021. One of the most shocking data points: Average revenue per user dropped to $64, down from a recent high of $137 in Q1 2021. At the same time, Robinhood actually reported a decrease in monthly active users, from 18.9 million in Q3 2021 to 17.3 million in Q4 2021.

Keep Reading Show less
Hirsh Chitkara

Hirsh Chitkara ( @HirshChitkara) is a is a reporter at Protocol focused on the intersection of politics, technology and society. Before joining Protocol, he helped write a daily newsletter at Insider that covered all things Big Tech. He's based in New York and can be reached at hchitkara@protocol.com.

Latest Stories
Bulletins