Bulletins

​Google's search AI will flag queries that are really a cry for help

The company will apply its MUM language model to Google and YouTube to detect searches related to suicide, domestic violence, sexual assault and substance abuse in the hopes of providing information to help people stay safer.

golden gate bridge

Searches with terms like "suicide hotspots," which include San Francisco's Golden Gate Bridge, might now generate results that include ways for searchers to get they help they might need.

Photo: Maarten van den Heuvel/Unsplash

A search for “suicide hotspots” on Google turns up a Wikipedia page listing places across the globe where people have flocked to take their own lives, from a forest on Mt. Fuji to the Golden Gate Bridge. The same search on YouTube turns up videos about common spots for suicide, too.

The humans working at Google realize that when people search for information like this, it may not be a voyeuristic inquiry or a recreational travel query. It may be a cry for help.


Now, the company said its latest AI model, MUM, can pick up on those communication signals, too. “Our previous systems understood this query to be generally information-seeking because ‘hot spots’ is language that can often be used to seek out information, such as in travel cases, for example. But MUM is able to detect that ‘Sydney suicide hot spots’ relates to common jumping spots for suicide in Sydney,” said Anne Merritt, product manager for Health and Information Quality at Google.

The company said it will apply the AI language model to Google and YouTube searches that it detects as related to suicide, domestic violence, sexual assault and substance abuse in the hopes of providing search results linking to trustworthy information to help people stay safer.

When Google introduced MUM – or Multitask Unified Model -- about a year ago, it said the language model was more powerful than its open-source language model BERT. MUM can learn from multimodal inputs, such as text, video, images and voice data. It is also capable of few-shot and zero-shot learning, meaning it requires fewer data inputs than BERT does to learn and improve, including when it comes to information involving multiple languages.

“MUM is able to help us understand longer or more complex queries like: ‘Why did he attack me when I said I don't love him.’ It may be obvious to humans that this query is about domestic violence, but long, natural-language queries like these are difficult for our systems to understand without advanced AI,” said Merritt.

While Google touts MUM’s ability to understand more nuanced human communications, it also said its BERT model has helped to reduce the portion of shocking or unexpected search results in the last year by 30%. “It’s been especially effective in reducing explicit content for searches related to ethnicity, sexual orientation and gender, which can disproportionately impact women and especially women of color,” the company said.

However, the company said those improvements only affect Google web, image and video search results, rather than the autocomplete feature of its search engine. That autocomplete function – which generates possible keywords to complete a search query as someone is entering it – has drawn criticism over the years for generating misinformation or racist or sexist keywords.

Latest Bulletins

Mobile game revenue will decline for the first time in history this year, market research firm Newzoo now says in a revised outlook for the 2022 global games market. While the whole game industry is expected to contract by 4.3% — another first since Newzoo began tracking the market in 2007 — the company is predicting a 6.4% decline in mobile game spending on top of a 4.2% decline in console game spending.

Keep ReadingShow less

Amazon is planning to lay off thousands of employees, Protocol has learned, ahead of what the company has cautioned will be a slow holiday shopping season.

Keep ReadingShow less

Google agreed to pay $391.5 million and make changes to its user privacy controls as part of a settlement with a coalition of 40 state attorneys general. The coalition accused Google of misleading customers about location-tracking practices that informed ad targeting.

Keep ReadingShow less

FTX has filed for bankruptcy and the crypto company also announced that founder Sam Bankman-Fried has resigned as CEO.

Keep ReadingShow less

Salesforce recently updated its internal policies to make it easier for managers to terminate employees for performance issues without HR involvement, Protocol has learned, a move that comes as the software giant looks to shed as many as 2,500 jobs.

Keep ReadingShow less

The Consumer Financial Protection Bureau said fraud and scam reports comprise the top complaint it receives about virtual currencies — and that customers are finding little help from companies when it happens.

Keep ReadingShow less

Elon Musk sent his first email to Twitter staff late Wednesday, warning of a difficult economic road ahead and telling employees they need to be in office for a minimum of 40 hours per week. "Sorry that this is my first email to the whole company, but there is no way to sugarcoat the message," he began, ominously.

Keep ReadingShow less

Binance isn’t buying FTX after all. The crypto giant said Wednesday it has decided that it “will not pursue the potential acquisition” based on a “corporate due diligence” review.

Keep ReadingShow less

On Wednesday, John Kerry unveiled a plan for a new carbon credit program aimed at mobilizing private capital to help middle-income countries transition away from coal and move toward renewable energy.

Keep ReadingShow less

Meta announced it was laying off more than 11,000 employees Wednesday morning, slashing jobs in its recruiting department and refocusing its remaining team on AI discovery, ads, and its investment in the metaverse.

"I want to take accountability for these decisions and for how we got here," Mark Zuckerberg wrote in a message to employees that was also posted online. "I know this is tough for everyone, and I’m especially sorry to those impacted."

Keep ReadingShow less

Al Gore has one mission this week at COP27, and that’s to give climate negotiators what he hopes will be a critical tool to address the crisis at hand: an independent, global inventory of greenhouse gas emissions, down to the individual facility.

The Climate TRACE coalition just released the world’s most detailed inventory of global greenhouse gas emissions, which Gore, a founding member, is unveiling on Wednesday at the United Nations climate summit in Egypt.

Keep ReadingShow less

Way back in March, your friendly Protocol Climate team offered you some tips for writing a climate plan that doesn’t suck. Surely you took that advice. But if for some reason you didn’t, the United Nations has your back.

Keep ReadingShow less

Binance CEO Changpeng “CZ” Zhao said Tuesday the crypto powerhouse signed a deal to acquire rival FTX.

Keep ReadingShow less

Salesforce is preparing for a major round of layoffs that could affect as many as 2,500 workers across the software vendor, Protocol has learned, in a bid to cut costs amid a new activist investor challenge and harsh economic conditions.

Keep ReadingShow less

BlockFi has introduced a new digital assets interest product for accredited investors, after previously agreeing to shut down a yield-paying crypto product that the SEC said was illegal.

Keep ReadingShow less

The Justice Department said Monday it seized $3.4 billion worth of bitcoin stolen in the 2012 hack of the Silk Road dark web marketplace.

Keep ReadingShow less

U.S. election infrastructure is exceedingly secure, and voter fraud here is so rare it’s comparable to your annual chances of getting struck by lightning. Despite this, former President Donald Trump and a long list of allies in the Republican Party have spent the last two years questioning the overall integrity of the U.S. election system. Many of those allies are now candidates themselves, and their coordinated attack on the country’s status as a democracy is not a relic of 2020. Some have already started repeating these “Big Lie” charges ahead of next week’s midterms. And the social platforms that help them spread their message have prepared few measures to stop it.

Keep ReadingShow less

The White House just laid out its climate tech priorities to reach net zero by 2050.

Keep ReadingShow less

Coinbase said Thursday that it lost more users in the third quarter. But the decline wasn’t the disastrous drop that Wall Street was expecting, and that sparked a rally in the crypto company’s shares after-hours.

Keep ReadingShow less

The Biden administration announced $9 billion in funding Wednesday to improve home efficiency, which could help support the installation of up to 500,000 heat pumps. With winter approaching and utilities warning of gas shortages, there are some major challenges facing the technology that money can be used to tackle.

Keep ReadingShow less

Block beat earnings expectations, with strong growth largely fueled by its Cash App business. Traders sent shares up more than 12% after-hours Thursday.

Keep ReadingShow less

Stripe is laying off 14% of its staff, its co-founders said Thursday, as the fintech startup must start "building differently for leaner times."

Keep ReadingShow less

Roku saw its revenue growth slow in Q3, and warned investors Wednesday that things are about to get worse: “A lot of Q4 ad campaigns are being canceled,” said Roku CEO Anthony Wood during the company’s Q4 earnings call. “We’re seeing lots of big categories pull back. Telecom, insurance … even toy marketers are planning on reducing their spending.”

Keep ReadingShow less

Green jobs and corporate climate pledges abound, but skilled sustainability professionals are scarce.

Keep ReadingShow less

Robinhood reported a drop in third-quarter revenue but also a narrower loss on Wednesday, in a sign that it might be stabilizing its business as it attempts to recover from a staggering drop in the stock and crypto trading activity that fueled its growth.

Keep ReadingShow less
Bulletins