People

The startup behind Facebook’s new reality show wants to upend cloud entertainment

Genvid CEO Jacob Navok thinks Google, Amazon and Microsoft have cloud gaming all wrong.

The startup behind Facebook’s new reality show wants to upend cloud entertainment

Rival Peak is a Facebook Originals animated reality show running over a 12-week season. Think "Lost" meets "Fantasy Island" meets "Survivor."

Image: Facebook

Imagine yelling at live television and the characters actually hear you and respond in real time. Imagine watching a live streamer and affecting the content of the game they're playing — while they're playing — just by clicking or tapping the stream itself. Imagine online worlds you can explore with other real people simply through an interactive video stream, no downloads of any kind required.

Totally new forms of entertainment don't come along too often. Yet the path toward those innovative scenarios may become real on Wednesday as Facebook and Genvid Technologies release a genre-defying online experience called Rival Peak.

Trying to succinctly describe Rival Peak in traditional terms quickly descends into buzzword purgatory. It is an interactive live reality show. It is also a massively multiplayer, AI-powered cloud streaming game.

Whatever you call it, Rival Peak feels like a window into one future of interactive entertainment. It is also the public debut for Genvid and Jacob Navok, the 38-year-old New Yorker and former Square Enix executive who, as Genvid's CEO, has emerged as a leader of a fresh approach to cloud gaming, one based on new forms of engagement rather than just porting existing games to server farms.

For example, here's how Rival Peak works: Rival Peak is a Facebook Originals animated reality show running over a 12-week season. The dozen contestants are digital characters from around the world who have been dropped in a forest in the Pacific Northwest at the base of mysterious Mount Pneuma. They are competing for the opportunity to have one of their deepest wishes fulfilled. Of course, every week one of the contestants will be eliminated and the real narrative emerges from the "unscripted" drama that erupts among them. In Hollywood parlance, think "Lost" meets "Fantasy Island" meets "Survivor."

The difference from traditional television is that every single one of the millions of people who "watch" the show anywhere on Facebook will be able to direct the characters in real time and so shape the eventual narrative that emerges truly unscripted. Any time 24/7, anyone can tune in to a separate stream for each of the characters on the show and help decide what that character will do next, whether search for a secret treasure or socialize with another contestant. Each virtual character is run by advanced AI algorithms that incorporate the collective input and choices of the human audience.

And then everything is wrapped up each week with a live action video episode hosted by actor and author Wil Wheaton.

Matthew Henick, Facebook's vice president of content planning and strategy, said he greenlit Rival Peak because it fundamentally erodes the barrier between viewer and participant.

"When you think about the spectrum between passive video and gaming, there's always been this belief that they're going to merge somehow into some sort of new format, but so much of the innovation that's happened in the entertainment space has really been about business models more than anything," Henick said. "We haven't really seen a partner or an industry take the technological advances we've made in terms of the social internet and cloud, and use that to build an experience that actually puts people at the center. So when Jacob and Genvid threw out this project, light bulbs started going off for me in terms of this was an experiment we wanted to get on board with."

While the adventurers are exploring the forest, the level of human engagement with each character determines which contestant gets eliminated each week. So as a viewer you are also a player (tapping the fishbowl) or you can just watch the fish. As you engage with your favorite characters, you are recognized for your level of contribution to those characters' fate.

It all combines to break down the traditional barrier between static, noninteractive media (where you are merely watching or consuming something created somewhere else by someone else, be it a book, a film, a website or a painting) and interactive entertainment (generally called a game) where you make active decisions that affect the narrative. And whether you play or just watch, Rival Peak is delivered through what appears to be a normal Facebook video stream without any special software.

People who "watch" the show anywhere on Facebook will be able to direct the characters in real time and so shape the eventual narrative that emerges truly unscripted.Image: Facebook

But of course this new kind of experience requires a tremendous amount of special software behind the scenes. Most of the magic behind Rival Peak that enables real-time interactive streaming comes from Genvid. The company has raised $53 million from investors including March Capital Partners, Makers Fund and entities controlled by Tencent, NTT DoCoMo, Samsung and Li Ka-shing, the legendary Hong Kong magnate. Rival Peak is the first of several innovative interactive experiences Genvid is creating for large multinational technology and media companies. (For Rival Peak, Genvid enlisted Pipeworks Studios and dj2 Entertainment for help with game and content development.)

Rival Peak is built in Unity, a popular game engine, but Genvid's technology also supports Epic's Unreal Engine. Genvid has developed software to timecode gameplay and video streams and then synchronize them. Genvid also developed a web interface and a full cloud gaming backend supported by Amazon Web Services instances. It all allows video streams to become truly interactive (click the stream and things happen within the underlying content, be it a video game or a sports statistic.).

The technologies can help make traditional streams more interactive, but can also enable fundamentally new sorts of interactive experience that exist only within a stream and are optimized for allowing many people to engage simultaneously. In that sense, Genvid's approach — now embraced by Facebook — is a prod and challenge to the cloud gaming strategies adopted by tech powerhouses including Google (Stadia), Microsoft (xCloud), Amazon (Luna) and Nvidia (GeForce Now).

Though there are differences among them, each of those four companies' cloud gaming strategies focuses for now on using cloud as a delivery mechanism for games originally created for other platforms. It's about delivering existing PC and console games without the PC or console.

In fairness, that is more than challenging enough. The fact that each of those Big Tech gaming services delivers adequate responsiveness and gameplay at all is impressive. But Navok's question is: Can't cloud and interactive streaming be harnessed to deliver brand-new sorts of entertainment?

"The opportunity for cloud gaming has been framed wrong," Navok said in an interview last week. "It's been framed from the perspective of finding a new audience by not having to buy consoles anymore. But I think that new audiences will come not from a focus on playing games but from a focus on interacting with content in new ways. And that is what's different about Rival Peak."

Count Matthew Ball among the believers. Navok first met the much-followed media investor and analyst in 2018, and within months Ball signed up as a Genvid adviser and dealmaker.

"There is a very long history of new technology creating entirely new genres and formats," Ball said. "Our perspective is that there is an emergent opportunity to bring together the best of broadcast, Hollywood, traditional long-form storytelling with the richly interactive experiences associated with video games and that mixing them through technology can produce a new category of entertainment."

"The idea with Genvid and Rival Peak is we can tap into the tribalism of sports fans, the audience engagement of 'American Idol,' the sense of agency of 'Bandersnatch' and new types of community-based storytelling like Twitch Plays Pokemon," Ball said.

Last year, Ball pitched Genvid's vision and a Rival Peak prototype to Henick, who joined Facebook from BuzzFeed in 2018. Henick saw that the true innovation in Genvid's approach is in reducing user barriers to interactivity, and even perhaps in liberating interactivity from the notion of "gaming" altogether.

"It's funny; my first instinct was to be protective of it," Henick said. "I don't want this to become just a gaming product. Even just calling it a game will turn people off potentially because they think it requires a controller or some kind of learning curve or there's a heavy download for it. And so I wanted to make sure that the top of the funnel is as big as possible and as many people could bump up against it. And you can imagine that there's other partners where it would become more of an endemic gaming product than some kind of new entertainment experience."

Genvid now has around 80 employees. Navok's interest in cloud entertainment dates back a decade, when he was working in Tokyo on strategic planning directly for Yoichi Wada, then-CEO of Square Enix, the famed Japanese video game company. At the time, Square Enix was being pitched by cloud gaming pioneers OnLive and Gaikai. Wada directed Navok to figure out the cloud gaming puzzle.

Navok's investigation became a Square Enix cloud subsidiary called Shinra Technologies (named after the fictional Shinra corporation in the company's Final Fantasy series). While Navok was helping run Shinra, Twitch emerged as perhaps the important new force in gaming in years.

"Wada-san and I watched Twitch Plays Pokemon, and I remember saying to him: 'Here is a million people, playing a stream, together. This is effectively a cloud game, but one we hadn't thought of,'" Navok recalled.

Navok and Wada left Square Enix on the same day in 2016, shortly after Shinra closed. Shortly afterward, Navok co-founded Genvid with Square Enix and Shinra alumni and Wada as an adviser.

"Jacob is the perfect founder for this, from his technology expertise, his temperament with the team and his ability to shepherd a vision," Ball said. "These new and diverse sorts of entertainment experiences you're starting to see with Rival Peak are a result of a decade-long journey for him."

Even as Genvid delivers its first mass product in Rival Peak, a big question facing the company is how much to focus on building core technology tools to license to other developers versus concentrating on making its own games and products for distributors like Facebook and others. With powerful Asian conglomerates behind it, Genvid is swimming among potential partners and rivals from YouTube and Stadia to Twitch, Unity and Epic, not to mention Microsoft.

"We're working on future projects that use our technology to go even deeper than Rival Peak," Navok said. "Rival Peak is very simple and easy to use. But for other platforms it could look very different. For example, we're working on a horror prototype now where viewers solve simple puzzles like Among Us. We're working on live sports projects and other projects we can't talk about yet. We're just excited to keep delivering new kinds of experiences."

Fintech

Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep Reading Show less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep Reading Show less
FTA
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.
Enterprise

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep Reading Show less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep Reading Show less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.

Enterprise

Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep Reading Show less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories
Bulletins