How Unity aims to give sports fans video game-like superpowers

Unity is looking to change the world of sports with volumetric capture and real-time 3D. First up: UFC fights.

Gif of a UFC fight from one fighter’s point of view

Unity's 3D capture of UFC fights allows for otherwise impossible camera angles.

Image: Unity

Imagine watching a UFC fight from the point of view of one of the fighters. Now imagine being able to pause that fight, switch camera angles and closely analyze a fighter's stance. Rotate the fighters to find another camera angle with the perfect vantage point, unpause, and watch the opposing fighter tap out while zooming in on his face.

What sounds like a video game is actually part of a demo that Unity executive Peter Moore is set to share with a couple hundred European sports executives at an industry event in London this week. Moore joined the game engine maker as its first SVP and GM of live sports and entertainment in January, and he now aims to bring the kind of real-time technology that's rapidly changing how Hollywood is making movies and TV shows to the world of live sports. This is part of a project the company calls Metacast.

"Sports fans love to analyze every goal score, touchdown, punch thrown," Moore recently told Protocol. "[They] love to micro-analyze every movement." By capturing sporting events in 3D, Unity promises to give fans superpowers, allowing them to become the director of their own sportscast.

"This new technology will revolutionize the way people consume sports, and Peter is the perfect person to lead this new division at Unity," said Unity CEO John Riccitiello.

To kick off its ambitious expansion into the world of sports, Unity has partnered with the UFC on research and development. As part of that partnership, Unity recently had two fighters spar off on a volumetric capture stage equipped with over 100 cameras for the demo that Moore is set to unveil this week.

As a next step, the game engine company is looking to build its own Octagon fight ring, matching UFC specs, to experiment with camera placements. The ultimate goal is to incorporate the cameras into the Octagon in a way that it could be rolled out in the field, ready to capture fights in 3D without obstructing the audience or endangering the fighters. "It's trial and error," Moore said. "It's getting the calibration right."

The UFC represents an interesting launch partner for Unity: Not only are its fans young, tech-savvy and willing to spend real dollars on premium content, but the fights themselves are also happening in a controlled environment, which makes the capture process a lot easier.

However, Unity's sports ambitions go far beyond two-person sparring. Moore's demo also includes 3D footage of a rugby game, complete with the ability to dynamically add data layers and zoom in on individual players.

Those features aren't just great for super fans, but could also benefit professionals, said Moore, who served as the CEO of Liverpool FC for three years before joining Unity. "I got to see the inside workings of the world's biggest football club, and I saw it's a club that's analytically driven, that believes in sports science, believes in data," he said.

Giving coaches access to 3D capture data could allow them to much more closely look at individual players. "It's an incredible tool to do [an] analysis of why certain players simply don't get hurt and can play 50 games in a season, and some players get hurt five or six times," he said. Eventually, that technology could also trickle down to schools and amateur sports, giving basketball coaches a way to capture and mark up training games, thanks to Lidar-equipped mobile devices capable of capturing 3D footage.

How real-time 3D footage is going to be distributed still remains to be seen. In the short term, this kind of footage will most likely power post-game analysis for TV pundits. But in the long run, it's also possible that fans will have direct access to the footage, allowing them to rewatch key scenes and personalize their own sportscasts. "In the future, every sporting game will be broadcast three-dimensionally," Moore predicted.

Ultimately, this could also help make sports more appealing to younger viewers who grew up with esports and 6-second GIFs. Moore even likened it to other tectonic shifts in broadcast history. "I'm old enough to remember black-and-white television, and color television blew my mind. I could see things in a different way," he said. "Some of the technologies since then have been interesting, but nothing this revolutionary."

Fintech

Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep Reading Show less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep Reading Show less
FTA
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.
Enterprise

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep Reading Show less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep Reading Show less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.

Enterprise

Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep Reading Show less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories
Bulletins