How Unity aims to give sports fans video game-like superpowers

Unity is looking to change the world of sports with volumetric capture and real-time 3D. First up: UFC fights.

Gif of a UFC fight from one fighter’s point of view

Unity's 3D capture of UFC fights allows for otherwise impossible camera angles.

Image: Unity

Imagine watching a UFC fight from the point of view of one of the fighters. Now imagine being able to pause that fight, switch camera angles and closely analyze a fighter's stance. Rotate the fighters to find another camera angle with the perfect vantage point, unpause, and watch the opposing fighter tap out while zooming in on his face.

What sounds like a video game is actually part of a demo that Unity executive Peter Moore is set to share with a couple hundred European sports executives at an industry event in London this week. Moore joined the game engine maker as its first SVP and GM of live sports and entertainment in January, and he now aims to bring the kind of real-time technology that's rapidly changing how Hollywood is making movies and TV shows to the world of live sports. This is part of a project the company calls Metacast.

"Sports fans love to analyze every goal score, touchdown, punch thrown," Moore recently told Protocol. "[They] love to micro-analyze every movement." By capturing sporting events in 3D, Unity promises to give fans superpowers, allowing them to become the director of their own sportscast.

"This new technology will revolutionize the way people consume sports, and Peter is the perfect person to lead this new division at Unity," said Unity CEO John Riccitiello.

To kick off its ambitious expansion into the world of sports, Unity has partnered with the UFC on research and development. As part of that partnership, Unity recently had two fighters spar off on a volumetric capture stage equipped with over 100 cameras for the demo that Moore is set to unveil this week.

As a next step, the game engine company is looking to build its own Octagon fight ring, matching UFC specs, to experiment with camera placements. The ultimate goal is to incorporate the cameras into the Octagon in a way that it could be rolled out in the field, ready to capture fights in 3D without obstructing the audience or endangering the fighters. "It's trial and error," Moore said. "It's getting the calibration right."

The UFC represents an interesting launch partner for Unity: Not only are its fans young, tech-savvy and willing to spend real dollars on premium content, but the fights themselves are also happening in a controlled environment, which makes the capture process a lot easier.

However, Unity's sports ambitions go far beyond two-person sparring. Moore's demo also includes 3D footage of a rugby game, complete with the ability to dynamically add data layers and zoom in on individual players.

Those features aren't just great for super fans, but could also benefit professionals, said Moore, who served as the CEO of Liverpool FC for three years before joining Unity. "I got to see the inside workings of the world's biggest football club, and I saw it's a club that's analytically driven, that believes in sports science, believes in data," he said.

Giving coaches access to 3D capture data could allow them to much more closely look at individual players. "It's an incredible tool to do [an] analysis of why certain players simply don't get hurt and can play 50 games in a season, and some players get hurt five or six times," he said. Eventually, that technology could also trickle down to schools and amateur sports, giving basketball coaches a way to capture and mark up training games, thanks to Lidar-equipped mobile devices capable of capturing 3D footage.

How real-time 3D footage is going to be distributed still remains to be seen. In the short term, this kind of footage will most likely power post-game analysis for TV pundits. But in the long run, it's also possible that fans will have direct access to the footage, allowing them to rewatch key scenes and personalize their own sportscasts. "In the future, every sporting game will be broadcast three-dimensionally," Moore predicted.

Ultimately, this could also help make sports more appealing to younger viewers who grew up with esports and 6-second GIFs. Moore even likened it to other tectonic shifts in broadcast history. "I'm old enough to remember black-and-white television, and color television blew my mind. I could see things in a different way," he said. "Some of the technologies since then have been interesting, but nothing this revolutionary."

Climate

2- and 3-wheelers dominate oil displacement by EVs

Increasingly widespread EV adoption is starting to displace the use of oil, but there's still a lot of work to do.

More electric mopeds on the road could be an oil demand game-changer.

Photo: Humphrey Muleba/Unsplash

Electric vehicles are starting to make a serious dent in oil use.

Last year, EVs displaced roughly 1.5 million barrels per day, according to a new analysis from BloombergNEF. That is more than double the share EVs displaced in 2015. The majority of the displacement is coming from an unlikely source.

Keep Reading Show less
Lisa Martine Jenkins

Lisa Martine Jenkins is a senior reporter at Protocol covering climate. Lisa previously wrote for Morning Consult, Chemical Watch and the Associated Press. Lisa is currently based in Brooklyn, and is originally from the Bay Area. Find her on Twitter ( @l_m_j_) or reach out via email (ljenkins@protocol.com).

Sponsored Content

Foursquare data story: leveraging location data for site selection

We take a closer look at points of interest and foot traffic patterns to demonstrate how location data can be leveraged to inform better site selecti­on strategies.

Imagine: You’re the leader of a real estate team at a restaurant brand looking to open a new location in Manhattan. You have two options you’re evaluating: one site in SoHo, and another site in the Flatiron neighborhood. Which do you choose?

Keep Reading Show less
Enterprise

The limits of AI and automation for digital accessibility

AI and automated software that promises to make the web more accessible abounds, but people with disabilities and those who regularly test for digital accessibility problems say it can only go so far.

The everyday obstacles blocking people with disabilities from a satisfying digital experience are immense.

Image: alexsl/Getty Images

“It’s a lot to listen to a robot all day long,” said Tina Pinedo, communications director at Disability Rights Oregon, a group that works to promote and defend the rights of people with disabilities.

But listening to a machine is exactly what many people with visual impairments do while using screen reading tools to accomplish everyday online tasks such as paying bills or ordering groceries from an ecommerce site.

Keep Reading Show less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Fintech

The crypto crash's violence shocked Circle's CEO

Jeremy Allaire remains upbeat about stablecoins despite the UST wipeout, he told Protocol in an interview.

Allaire said what really caught him by surprise was “how fast the death spiral happened and how violent of a value destruction it was.”

Photo: Heidi Gutman/CNBC/NBCU Photo Bank/NBCUniversal via Getty Images

Circle CEO Jeremy Allaire said he saw the UST meltdown coming about six months ago, long before the stablecoin crash rocked the crypto world.

“This was a house of cards,” he told Protocol. “It was very clear that it was unsustainable and that there would be a very high risk of a death spiral.”

Keep Reading Show less
Benjamin Pimentel

Benjamin Pimentel ( @benpimentel) covers crypto and fintech from San Francisco. He has reported on many of the biggest tech stories over the past 20 years for the San Francisco Chronicle, Dow Jones MarketWatch and Business Insider, from the dot-com crash, the rise of cloud computing, social networking and AI to the impact of the Great Recession and the COVID crisis on Silicon Valley and beyond. He can be reached at bpimentel@protocol.com or via Google Voice at (925) 307-9342.

A DTC baby formula startup is caught in the center of a supply chain crisis

After weeks of “unprecedented growth,” Bobbie co-founder Laura Modi made a hard decision: to not accept any more new customers.

Parents unable to track down formula in stores have been turning to Facebook groups, homemade formula recipes and Bobbie, a 4-year-old subscription baby formula company.

Photo: JIM WATSON/AFP via Getty Images

The ongoing baby formula shortage has taken a toll on parents throughout the U.S. Laura Modi, co-founder of formula startup Bobbie, said she’s been “wearing the hat of a mom way more than that of a CEO” in recent weeks.

“It's scary to be a parent right now, with the uncertainty of knowing you can’t find your formula,” Modi told Protocol.

Keep Reading Show less
Nat Rubio-Licht

Nat Rubio-Licht is a Los Angeles-based news writer at Protocol. They graduated from Syracuse University with a degree in newspaper and online journalism in May 2020. Prior to joining the team, they worked at the Los Angeles Business Journal as a technology and aerospace reporter.

Latest Stories
Bulletins