Bulletins

Sony's AI race car driver beat the world's best humans. Now it's going to train players.

The company says its new Gran Turismo bot is a breakthrough in the field of artificial intelligence research.

A screenshot of the upcoming Gran Turismo 7.

The PlayStation-maker is calling its new AI software Gran Turismo Sophy.

Image: Sony

Sony has developed what it's calling a breakthrough artificial intelligence program for the Gran Turismo series of PlayStation racing games. The software, called Gran Turismo Sophy, is so sophisticated, Sony says, that it handily beat a group of the world's best virtual race car drivers in test version of the 2017 game Gran Turismo Sport in October.


“Outracing human drivers so skillfully in a head-to-head competition represents a landmark achievement for AI,” Chris Gerdes, a Stanford professor specializing in autonomous driving, wrote in a Nature article published alongside Sony's research. Gerdes said this research could one day affect self-driving car development, according to Wired. "GT Sophy’s success on the track suggests that neural networks might one day have a larger role in the software of automated vehicles than they do today,” Gerdes wrote.

Using video games to develop and train novel AI systems has become a popular research strategy for the world's most cutting-edge AI labs. In just the last decade or so, board and card games like Go and Texas hold 'em and sophisticated strategy video games like Starcraft and Dota have been "solved," so to speak, after becoming test beds for some of the world's most advanced forms of self-learning AI. Many of these research teams use a variety of AI training called deep reinforcement learning, which effectively allows an AI to evolve over time using various combinations of trial and error and reward systems modeled after human neural development.

Gran Turismo Sophy is no different, though Sony said learning to operate a virtual race car as realistic as those deployed in Gran Turismo presented a unique challenge for its research team. While AI programs have become superhuman at numerous games, these programs often excel at ones in which they're able to take considerable time computing the best move to make. In a racing game, the AI has to make continuous judgment calls while using near-perfect reflexes and obeying restrictions Sony put in place to replicate the rules of a real-life race, such as penalties for overly aggressive driving.

"In order to train the agent at massive scale, we developed a novel distributed reinforcement learning platform that can run many instances of GT Sport. We deployed these systems at massive scale using SIE’s cloud gaming infrastructure," said Michael Spranger, the chief operating officer of Sony AI, in a virtual press conference on Wednesday. "Finding the right balance between aggressive but fair racing is one of the defining characteristics of motorsport. Collectively, this is what makes GT Sophy a unique AI achievement."

Sony said it plans to incorporate Gran Turismo Sophy into the upcoming Gran Turismo 7, which releases in March, as a training tool for players. Like in chess, Go and other games, AI programs have shown to have a positive effect on human play, highlighting unique strategies humans had not yet discovered and pushing opponents to push beyond their limits to try to keep pace with machine play.

“Sophy takes some racing lines that a human driver would never think of,” Gran Turismo creator Kazunori Yamauchi told Wired. “I think a lot of the textbooks regarding driving skills will be rewritten.”

Correction: An earlier version of this story misstated the year Gran Turismo Sport was released. This story was updated on Feb. 9, 2022.

Latest Bulletins

Mobile game revenue will decline for the first time in history this year, market research firm Newzoo now says in a revised outlook for the 2022 global games market. While the whole game industry is expected to contract by 4.3% — another first since Newzoo began tracking the market in 2007 — the company is predicting a 6.4% decline in mobile game spending on top of a 4.2% decline in console game spending.

Keep Reading Show less

Amazon is planning to lay off thousands of employees, Protocol has learned, ahead of what the company has cautioned will be a slow holiday shopping season.

Keep Reading Show less

Google agreed to pay $391.5 million and make changes to its user privacy controls as part of a settlement with a coalition of 40 state attorneys general. The coalition accused Google of misleading customers about location-tracking practices that informed ad targeting.

Keep Reading Show less

FTX has filed for bankruptcy and the crypto company also announced that founder Sam Bankman-Fried has resigned as CEO.

Keep Reading Show less

Salesforce recently updated its internal policies to make it easier for managers to terminate employees for performance issues without HR involvement, Protocol has learned, a move that comes as the software giant looks to shed as many as 2,500 jobs.

Keep Reading Show less

The Consumer Financial Protection Bureau said fraud and scam reports comprise the top complaint it receives about virtual currencies — and that customers are finding little help from companies when it happens.

Keep Reading Show less

Elon Musk sent his first email to Twitter staff late Wednesday, warning of a difficult economic road ahead and telling employees they need to be in office for a minimum of 40 hours per week. "Sorry that this is my first email to the whole company, but there is no way to sugarcoat the message," he began, ominously.

Keep Reading Show less

Binance isn’t buying FTX after all. The crypto giant said Wednesday it has decided that it “will not pursue the potential acquisition” based on a “corporate due diligence” review.

Keep Reading Show less

On Wednesday, John Kerry unveiled a plan for a new carbon credit program aimed at mobilizing private capital to help middle-income countries transition away from coal and move toward renewable energy.

Keep Reading Show less

Meta announced it was laying off more than 11,000 employees Wednesday morning, slashing jobs in its recruiting department and refocusing its remaining team on AI discovery, ads, and its investment in the metaverse.

"I want to take accountability for these decisions and for how we got here," Mark Zuckerberg wrote in a message to employees that was also posted online. "I know this is tough for everyone, and I’m especially sorry to those impacted."

Keep Reading Show less

Al Gore has one mission this week at COP27, and that’s to give climate negotiators what he hopes will be a critical tool to address the crisis at hand: an independent, global inventory of greenhouse gas emissions, down to the individual facility.

The Climate TRACE coalition just released the world’s most detailed inventory of global greenhouse gas emissions, which Gore, a founding member, is unveiling on Wednesday at the United Nations climate summit in Egypt.

Keep Reading Show less

Way back in March, your friendly Protocol Climate team offered you some tips for writing a climate plan that doesn’t suck. Surely you took that advice. But if for some reason you didn’t, the United Nations has your back.

Keep Reading Show less

Binance CEO Changpeng “CZ” Zhao said Tuesday the crypto powerhouse signed a deal to acquire rival FTX.

Keep Reading Show less

Salesforce is preparing for a major round of layoffs that could affect as many as 2,500 workers across the software vendor, Protocol has learned, in a bid to cut costs amid a new activist investor challenge and harsh economic conditions.

Keep Reading Show less

BlockFi has introduced a new digital assets interest product for accredited investors, after previously agreeing to shut down a yield-paying crypto product that the SEC said was illegal.

Keep Reading Show less

The Justice Department said Monday it seized $3.4 billion worth of bitcoin stolen in the 2012 hack of the Silk Road dark web marketplace.

Keep Reading Show less

U.S. election infrastructure is exceedingly secure, and voter fraud here is so rare it’s comparable to your annual chances of getting struck by lightning. Despite this, former President Donald Trump and a long list of allies in the Republican Party have spent the last two years questioning the overall integrity of the U.S. election system. Many of those allies are now candidates themselves, and their coordinated attack on the country’s status as a democracy is not a relic of 2020. Some have already started repeating these “Big Lie” charges ahead of next week’s midterms. And the social platforms that help them spread their message have prepared few measures to stop it.

Keep Reading Show less

The White House just laid out its climate tech priorities to reach net zero by 2050.

Keep Reading Show less

Coinbase said Thursday that it lost more users in the third quarter. But the decline wasn’t the disastrous drop that Wall Street was expecting, and that sparked a rally in the crypto company’s shares after-hours.

Keep Reading Show less

The Biden administration announced $9 billion in funding Wednesday to improve home efficiency, which could help support the installation of up to 500,000 heat pumps. With winter approaching and utilities warning of gas shortages, there are some major challenges facing the technology that money can be used to tackle.

Keep Reading Show less

Block beat earnings expectations, with strong growth largely fueled by its Cash App business. Traders sent shares up more than 12% after-hours Thursday.

Keep Reading Show less

Stripe is laying off 14% of its staff, its co-founders said Thursday, as the fintech startup must start "building differently for leaner times."

Keep Reading Show less

Roku saw its revenue growth slow in Q3, and warned investors Wednesday that things are about to get worse: “A lot of Q4 ad campaigns are being canceled,” said Roku CEO Anthony Wood during the company’s Q4 earnings call. “We’re seeing lots of big categories pull back. Telecom, insurance … even toy marketers are planning on reducing their spending.”

Keep Reading Show less

Green jobs and corporate climate pledges abound, but skilled sustainability professionals are scarce.

Keep Reading Show less

Robinhood reported a drop in third-quarter revenue but also a narrower loss on Wednesday, in a sign that it might be stabilizing its business as it attempts to recover from a staggering drop in the stock and crypto trading activity that fueled its growth.

Keep Reading Show less
Bulletins