Bulletins

The sky’s the limit for AI tools like DALL-E, but investors have a rough road ahead

What looks like an interesting art tool has become a prime feeding ground for investors; part of the challenge now is finding the business case for AI-generated imagery.

yellow and blue dragon in the sky

Experts think AI imagery will be used with other forms of generative AI-like text.

Image generated by Midjourney; Protocol
It’s a famous startup saying that the next big thing will start out looking like a toy. And there’s no toy that VCs have been more excited about playing around with recently than DALL-E and other generative AI image tools.

Put a few key words into a tool like Midjourney, Stable Diffusion, or DALL-E and it’s easy to see why the whimsical (and often wacky) images have captured investors’ imagination. An AI-generated artwork even recently won an art competition at the Colorado State Fair, a result that didn’t go over well among more traditional artists. It’s become disruptive enough that this week Getty announced a ban of AI-generated images on its platform, following similar moves by some online art communities.

What looks like an interesting art tool has become a prime feeding ground for investors. Investor interest has been nearly overwhelming for Poly’s Abhay Agarwal, who is building a “DALL-E for design assets” company. “It has literally been like dropping yourself into the Ganga River and fully being bathed in it,” Agarwal said of the interest. He’s already had over 80 meetings with VCs and is only halfway done following YC’s Demo Day.

  • The challenge now for investors is finding the business case in AI-generated imagery. Already, some companies like Stitch Fix have been experimenting with the technology, but with mixed success. “I feel quite strongly that these technologies are quite world-changing,” Khosla Ventures partner Kanu Gulati told me. “They’re still early. A lot of their shortcomings are known, but the community is super, super active and trying to resolve them.”
  • Perhaps unsurprisingly, the initial startup applications have been around design, marketing and e-commerce, like a company doing AI-generated stock imagery or a startup building AI models for fashion brands so they can skip photoshoots. Gulati has invested in startups like Rosebud, which is doing AI-generated photos and videos (including NFTs), while Khosla Ventures has directly backed research lab OpenAI, the creator of DALL-E. Poly is pitching itself as a way for designers to use AI to generate textures.
  • Already looking ahead, Gulati thinks AI imagery will be used with other forms of generative AI-like text, and that’s where more value can be created. “There will be huge industries out there giving Adobe a run for their money because of using these latest technologies,” Gulati said. “And these will be built on a new stack of AI-first companies.”

The hype wave is similar to GPT-3, a generative AI text tool with an API that businesses can build off of. The problem is that investors can easily fall into the trap of thinking the two generative models are the same.

  • For generative text, there can be a lower bar for quality and also a lower bar for utility. If the AI makes mistakes, it’s easy to clean up typos. But plenty of people can also write their own mediocre copy if needed, so the value of some tools is diminished if replacing a human with AI doesn’t really save much cost or work.
  • The bar for images is much higher, because if an image comes back where something is wrong, then it has to be tossed — you can’t correct it easily. But at the same time, the utility is high because, frankly, most humans can’t create a drawing anywhere near the quality of the output of the AI, Agarwal explained.
  • “For text modeling, someone can do a mediocre job of it on their own,” Agarwal said. “With image modeling, you can't. 99.9% of people in this world cannot create a convincing illustration, even given an infinite amount of time.”

Just because it’s magical doesn’t mean it can magic away its shortcomings. As Charlie Warzel pointed out in a smart piece, “What feels like magic is actually incredibly complicated and ethically fraught.”

  • The black box algorithms behind much of the programs have already raised serious concerns about copyright and other legal claims as it’s not known what imagery the models were trained off of. Stable Diffusion recently did release its training model, and much of it came from Pinterest imagery and Thomas Kinkade’s art, per Andy Baio’s analysis.
  • Already, there’s a lot of bias in the models. Run a search for a startup founder or venture capitalist and it almost always returns a white man as the image. Even a search that included “teacher,” a predominantly female profession, returned images of men. “Bias will continue to be a big challenge, which investors and founders have to solve before these become sustainable enterprises,” Gulati said.
  • And with every tool on the internet, what can be used for good can also be used for evil. Stable Diffusion recently open-sourced its technology in a way that could allow people to circumvent safeguards and create pornography, deepfakes, and violent imagery — something tools like DALL-E block. There are websites and Discord forums popping up specifically around AI-generated pornography already, and people posting images of Bernie Sanders in a “Mad Max” deepfake.

Creating a future for generative AI startups won’t be as easy as painting a picture of the opportunity. Founders and investors will have to both take responsibility for understanding the shortcomings of generative AI and solving them. It takes more than “hustling and flipping when you see a quick opportunity to leverage an open-source technology,” said Agarwal. Instead, he argued technologists need to become stewards of the technology and build it for whatever business application is needed. For Poly, that means creating and training its models around textures and design elements so that it can responsibly tailor the model in a way that allows it to build a business. “I don't believe that once a model was released into the open-source public that somehow that means that everybody can jump on that and start using it for whatever use case,” Agarwal said.

A version of this story appeared in Protocol's Pipeline newsletter. Sign up here to get it in your inbox every Saturday.

Latest Bulletins

Mobile game revenue will decline for the first time in history this year, market research firm Newzoo now says in a revised outlook for the 2022 global games market. While the whole game industry is expected to contract by 4.3% — another first since Newzoo began tracking the market in 2007 — the company is predicting a 6.4% decline in mobile game spending on top of a 4.2% decline in console game spending.

Keep ReadingShow less

Amazon is planning to lay off thousands of employees, Protocol has learned, ahead of what the company has cautioned will be a slow holiday shopping season.

Keep ReadingShow less

Google agreed to pay $391.5 million and make changes to its user privacy controls as part of a settlement with a coalition of 40 state attorneys general. The coalition accused Google of misleading customers about location-tracking practices that informed ad targeting.

Keep ReadingShow less

FTX has filed for bankruptcy and the crypto company also announced that founder Sam Bankman-Fried has resigned as CEO.

Keep ReadingShow less

Salesforce recently updated its internal policies to make it easier for managers to terminate employees for performance issues without HR involvement, Protocol has learned, a move that comes as the software giant looks to shed as many as 2,500 jobs.

Keep ReadingShow less

The Consumer Financial Protection Bureau said fraud and scam reports comprise the top complaint it receives about virtual currencies — and that customers are finding little help from companies when it happens.

Keep ReadingShow less

Elon Musk sent his first email to Twitter staff late Wednesday, warning of a difficult economic road ahead and telling employees they need to be in office for a minimum of 40 hours per week. "Sorry that this is my first email to the whole company, but there is no way to sugarcoat the message," he began, ominously.

Keep ReadingShow less

Binance isn’t buying FTX after all. The crypto giant said Wednesday it has decided that it “will not pursue the potential acquisition” based on a “corporate due diligence” review.

Keep ReadingShow less

On Wednesday, John Kerry unveiled a plan for a new carbon credit program aimed at mobilizing private capital to help middle-income countries transition away from coal and move toward renewable energy.

Keep ReadingShow less

Meta announced it was laying off more than 11,000 employees Wednesday morning, slashing jobs in its recruiting department and refocusing its remaining team on AI discovery, ads, and its investment in the metaverse.

"I want to take accountability for these decisions and for how we got here," Mark Zuckerberg wrote in a message to employees that was also posted online. "I know this is tough for everyone, and I’m especially sorry to those impacted."

Keep ReadingShow less

Al Gore has one mission this week at COP27, and that’s to give climate negotiators what he hopes will be a critical tool to address the crisis at hand: an independent, global inventory of greenhouse gas emissions, down to the individual facility.

The Climate TRACE coalition just released the world’s most detailed inventory of global greenhouse gas emissions, which Gore, a founding member, is unveiling on Wednesday at the United Nations climate summit in Egypt.

Keep ReadingShow less

Way back in March, your friendly Protocol Climate team offered you some tips for writing a climate plan that doesn’t suck. Surely you took that advice. But if for some reason you didn’t, the United Nations has your back.

Keep ReadingShow less

Binance CEO Changpeng “CZ” Zhao said Tuesday the crypto powerhouse signed a deal to acquire rival FTX.

Keep ReadingShow less

Salesforce is preparing for a major round of layoffs that could affect as many as 2,500 workers across the software vendor, Protocol has learned, in a bid to cut costs amid a new activist investor challenge and harsh economic conditions.

Keep ReadingShow less

BlockFi has introduced a new digital assets interest product for accredited investors, after previously agreeing to shut down a yield-paying crypto product that the SEC said was illegal.

Keep ReadingShow less

The Justice Department said Monday it seized $3.4 billion worth of bitcoin stolen in the 2012 hack of the Silk Road dark web marketplace.

Keep ReadingShow less

U.S. election infrastructure is exceedingly secure, and voter fraud here is so rare it’s comparable to your annual chances of getting struck by lightning. Despite this, former President Donald Trump and a long list of allies in the Republican Party have spent the last two years questioning the overall integrity of the U.S. election system. Many of those allies are now candidates themselves, and their coordinated attack on the country’s status as a democracy is not a relic of 2020. Some have already started repeating these “Big Lie” charges ahead of next week’s midterms. And the social platforms that help them spread their message have prepared few measures to stop it.

Keep ReadingShow less

The White House just laid out its climate tech priorities to reach net zero by 2050.

Keep ReadingShow less

Coinbase said Thursday that it lost more users in the third quarter. But the decline wasn’t the disastrous drop that Wall Street was expecting, and that sparked a rally in the crypto company’s shares after-hours.

Keep ReadingShow less

The Biden administration announced $9 billion in funding Wednesday to improve home efficiency, which could help support the installation of up to 500,000 heat pumps. With winter approaching and utilities warning of gas shortages, there are some major challenges facing the technology that money can be used to tackle.

Keep ReadingShow less

Block beat earnings expectations, with strong growth largely fueled by its Cash App business. Traders sent shares up more than 12% after-hours Thursday.

Keep ReadingShow less

Stripe is laying off 14% of its staff, its co-founders said Thursday, as the fintech startup must start "building differently for leaner times."

Keep ReadingShow less

Roku saw its revenue growth slow in Q3, and warned investors Wednesday that things are about to get worse: “A lot of Q4 ad campaigns are being canceled,” said Roku CEO Anthony Wood during the company’s Q4 earnings call. “We’re seeing lots of big categories pull back. Telecom, insurance … even toy marketers are planning on reducing their spending.”

Keep ReadingShow less

Green jobs and corporate climate pledges abound, but skilled sustainability professionals are scarce.

Keep ReadingShow less

Robinhood reported a drop in third-quarter revenue but also a narrower loss on Wednesday, in a sign that it might be stabilizing its business as it attempts to recover from a staggering drop in the stock and crypto trading activity that fueled its growth.

Keep ReadingShow less
Bulletins