How Unity aims to give sports fans video game-like superpowers

Unity is looking to change the world of sports with volumetric capture and real-time 3D. First up: UFC fights.

Gif of a UFC fight from one fighter’s point of view

Unity's 3D capture of UFC fights allows for otherwise impossible camera angles.

Image: Unity

Imagine watching a UFC fight from the point of view of one of the fighters. Now imagine being able to pause that fight, switch camera angles and closely analyze a fighter's stance. Rotate the fighters to find another camera angle with the perfect vantage point, unpause, and watch the opposing fighter tap out while zooming in on his face.

What sounds like a video game is actually part of a demo that Unity executive Peter Moore is set to share with a couple hundred European sports executives at an industry event in London this week. Moore joined the game engine maker as its first SVP and GM of live sports and entertainment in January, and he now aims to bring the kind of real-time technology that's rapidly changing how Hollywood is making movies and TV shows to the world of live sports. This is part of a project the company calls Metacast.

"Sports fans love to analyze every goal score, touchdown, punch thrown," Moore recently told Protocol. "[They] love to micro-analyze every movement." By capturing sporting events in 3D, Unity promises to give fans superpowers, allowing them to become the director of their own sportscast.

"This new technology will revolutionize the way people consume sports, and Peter is the perfect person to lead this new division at Unity," said Unity CEO John Riccitiello.

To kick off its ambitious expansion into the world of sports, Unity has partnered with the UFC on research and development. As part of that partnership, Unity recently had two fighters spar off on a volumetric capture stage equipped with over 100 cameras for the demo that Moore is set to unveil this week.

As a next step, the game engine company is looking to build its own Octagon fight ring, matching UFC specs, to experiment with camera placements. The ultimate goal is to incorporate the cameras into the Octagon in a way that it could be rolled out in the field, ready to capture fights in 3D without obstructing the audience or endangering the fighters. "It's trial and error," Moore said. "It's getting the calibration right."

The UFC represents an interesting launch partner for Unity: Not only are its fans young, tech-savvy and willing to spend real dollars on premium content, but the fights themselves are also happening in a controlled environment, which makes the capture process a lot easier.

However, Unity's sports ambitions go far beyond two-person sparring. Moore's demo also includes 3D footage of a rugby game, complete with the ability to dynamically add data layers and zoom in on individual players.

Those features aren't just great for super fans, but could also benefit professionals, said Moore, who served as the CEO of Liverpool FC for three years before joining Unity. "I got to see the inside workings of the world's biggest football club, and I saw it's a club that's analytically driven, that believes in sports science, believes in data," he said.

Giving coaches access to 3D capture data could allow them to much more closely look at individual players. "It's an incredible tool to do [an] analysis of why certain players simply don't get hurt and can play 50 games in a season, and some players get hurt five or six times," he said. Eventually, that technology could also trickle down to schools and amateur sports, giving basketball coaches a way to capture and mark up training games, thanks to Lidar-equipped mobile devices capable of capturing 3D footage.

How real-time 3D footage is going to be distributed still remains to be seen. In the short term, this kind of footage will most likely power post-game analysis for TV pundits. But in the long run, it's also possible that fans will have direct access to the footage, allowing them to rewatch key scenes and personalize their own sportscasts. "In the future, every sporting game will be broadcast three-dimensionally," Moore predicted.

Ultimately, this could also help make sports more appealing to younger viewers who grew up with esports and 6-second GIFs. Moore even likened it to other tectonic shifts in broadcast history. "I'm old enough to remember black-and-white television, and color television blew my mind. I could see things in a different way," he said. "Some of the technologies since then have been interesting, but nothing this revolutionary."

Enterprise

How I decided to leave the US and pursue a tech career in Europe

Melissa Di Donato moved to Europe to broaden her technology experience with a different market perspective. She planned to stay two years. Seventeen years later, she remains in London as CEO of Suse.

“It was a hard go for me in the beginning. I was entering inside of a company that had been very traditional in a sense.”

Photo: Suse

Click banner image for more How I decided seriesA native New Yorker, Melissa Di Donato made a life-changing decision back in 2005 when she packed up for Europe to further her career in technology. Then with IBM, she made London her new home base.

Today, Di Donato is CEO of Germany’s Suse, now a 30-year-old, open-source enterprise software company that specializes in Linux operating systems, container management, storage, and edge computing. As the company’s first female leader, she has led Suse through the coronavirus pandemic, a 2021 IPO on the Frankfurt Stock Exchange, and the acquisitions of Kubernetes management startup Rancher Labs and container security company NeuVector.

Keep Reading Show less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Sponsored Content

Great products are built on strong patents

Experts say robust intellectual property protection is essential to ensure the long-term R&D required to innovate and maintain America's technology leadership.

Every great tech product that you rely on each day, from the smartphone in your pocket to your music streaming service and navigational system in the car, shares one important thing: part of its innovative design is protected by intellectual property (IP) laws.

From 5G to artificial intelligence, IP protection offers a powerful incentive for researchers to create ground-breaking products, and governmental leaders say its protection is an essential part of maintaining US technology leadership. To quote Secretary of Commerce Gina Raimondo: "intellectual property protection is vital for American innovation and entrepreneurship.”

Keep Reading Show less
James Daly
James Daly has a deep knowledge of creating brand voice identity, including understanding various audiences and targeting messaging accordingly. He enjoys commissioning, editing, writing, and business development, particularly in launching new ventures and building passionate audiences. Daly has led teams large and small to multiple awards and quantifiable success through a strategy built on teamwork, passion, fact-checking, intelligence, analytics, and audience growth while meeting budget goals and production deadlines in fast-paced environments. Daly is the Editorial Director of 2030 Media and a contributor at Wired.
Enterprise

UiPath had a rocky few years. Rob Enslin wants to turn it around.

Protocol caught up with Enslin, named earlier this year as UiPath’s co-CEO, to discuss why he left Google Cloud, the untapped potential of robotic-process automation, and how he plans to lead alongside founder Daniel Dines.

Rob Enslin, UiPath's co-CEO, chats with Protocol about the company's future.

Photo: UiPath

UiPath has had a shaky history.

The company, which helps companies automate business processes, went public in 2021 at a valuation of more than $30 billion, but now the company’s market capitalization is only around $7 billion. To add insult to injury, UiPath laid off 5% of its staff in June and then lowered its full-year guidance for fiscal year 2023 just months later, tanking its stock by 15%.

Keep Reading Show less
Aisha Counts

Aisha Counts (@aishacounts) is a reporter at Protocol covering enterprise software. Formerly, she was a management consultant for EY. She's based in Los Angeles and can be reached at acounts@protocol.com.

Workplace

Figma CPO: We can do more with Adobe

Yuhki Yamashita thinks Figma might tackle video or 3D objects someday.

Figman CPO Yuhki Yamashita told Protocol about Adobe's acquisition of the company.

Photo: Figma

Figma CPO Yuhki Yamashita’s first design gig was at The Harvard Crimson, waiting for writers to file their stories so he could lay them out in Adobe InDesign. Given his interest in computer science, pursuing UX design became the clear move. He worked on Outlook at Microsoft, YouTube at Google, and user experience at Uber, where he was a very early user of Figma. In 2019, he became a VP of product at Figma; this past June, he became CPO.

“Design has been really near and dear to my heart, which is why when this opportunity came along to join Figma and rethink design, it was such an obvious opportunity,” Yamashita said.

Keep Reading Show less
Lizzy Lawrence

Lizzy Lawrence ( @LizzyLaw_) is a reporter at Protocol, covering tools and productivity in the workplace. She's a recent graduate of the University of Michigan, where she studied sociology and international studies. She served as editor in chief of The Michigan Daily, her school's independent newspaper. She's based in D.C., and can be reached at llawrence@protocol.com.

Climate

Microsoft lays out its climate advocacy goals

The tech giant has staked out exactly what kind of policies it will support to decarbonize the world and clean up the grid.

Microsoft published two briefs explaining what new climate policies it will advocate for.

Photo by Jeremy Bezanger on Unsplash

The tech industry has no shortage of climate goals, but they’ll be very hard to achieve without the help of sound public policy.

Microsoft published two new briefs on Sept. 22 explaining what policies it will advocate for in the realm of reducing carbon and cleaning up the grid. With policymakers in the U.S. and around the world beginning to weigh more stringent climate policies (or in the U.S.’s case, any serious climate policies at all), the briefs will offer a measuring stick for whether Microsoft is living up to its ideals.

Keep Reading Show less
Brian Kahn

Brian ( @blkahn) is Protocol's climate editor. Previously, he was the managing editor and founding senior writer at Earther, Gizmodo's climate site, where he covered everything from the weather to Big Oil's influence on politics. He also reported for Climate Central and the Wall Street Journal. In the even more distant past, he led sleigh rides to visit a herd of 7,000 elk and boat tours on the deepest lake in the U.S.

Latest Stories
Bulletins