People

Why Facebook thinks game-streaming is the future of Oculus VR

Jason Rubin, Facebook's vice president for special gaming initiatives, tells Protocol how Facebook thinks about gaming — and why streaming games are the future.

Jason Rubin

Jason Rubin's comments about cloud VR as an ultimate goal shed new light on Facebook's cloud strategy.

Photo: Courtesy of Facebook

In December, Facebook made one of its most intriguing acquisitions in years, spending a reported $78 million to buy PlayGiga, a Spanish company specializing in cloud gaming. It seemed to put Facebook on a path similar to that of Google, Microsoft, Nvidia and Amazon: Each is working on its own way to stream games from data centers rather than relying on PCs or consoles. But Facebook's cloud gaming ambitions have remained a mystery. For months the company has essentially refused to discuss it.

But in an interview with Protocol, Jason Rubin, a gaming lifer who is Facebook's vice president for special gaming initiatives, said that within Facebook, Oculus could present a major opportunity for cloud gaming. He said that while no actual cloud products were imminent, big brains at the company are thinking hard about how cloud technology could revolutionize virtual reality. This week, Facebook celebrates the first birthday of the Oculus Quest, the company's first modern VR headset that does not require connection to a computer. Facebook hopes that the Quest's ease-of-use propels VR into the consumer entertainment mainstream.

Rubin also said Facebook is pushing its previously far-flung gaming divisions to work more closely together. Oculus now appears to be operating more like a traditional Facebook division than as an independent subsidiary. Vivek Sharma, previously Facebook's head of gaming product, was promoted earlier this year to VP of gaming and is now Rubin's boss.

People close to Facebook's gaming divisions said the company will deploy PlayGiga's cloud gaming technology first on more traditional gaming platforms like phones and PCs. Yet Rubin's comments about cloud VR as an ultimate goal shed new light on Facebook's cloud strategy.

This interview has been lightly edited for length and clarity.

Before we get to products, I have a basic organizational question. I can't always understand what goes on within Facebook.

Yeah. Facebook's org structure is opaque internally, and I'm sure completely and utterly impossible to follow externally. For gaming, in the past the verticals were so separate, we didn't really have that much interaction with each other, but now there's a significant amount more chatter back and forth between the various gaming verticals, and we're really getting a lot closer and creating a more cohesive package to deliver.

Part of my transition onto the gaming team and away from AR/VR, which is Oculus' parent, is the fact that I bring all the knowledge of what was going on over there as well as all of the relationships, so the teams can get closer to each other. So the two major gaming pillars — Facebook Gaming and Oculus AR/VR — have that connection.

We're not going to call you the Facebook gaming czar yet, right?

No, there are multiple Facebook gaming czars. Think of us as that table of mob bosses that comes in and sits around the table, without the baseball bat moment. So far nobody's gotten the bat, but we're a bunch of people working on games.

Who else is at that table beside you and Mike Verdu [VP of content, AR/VR]?

Vivek Sharma, who is my manager and runs Facebook's gaming group. I'm working more on the day-to-day game strategy and he's working more on running the game group, as well as overseeing other things that I don't have a role in right now. So he and I are working over on the Facebook Gaming side.

You have Leo [Olebe, global director of games partnerships], who maintains a lot of the partnerships, as well as Ash [Jhaveri, VP of business development], his manager, who's the head of parts of our partnerships organization and certainly runs every game partnership, along with others outside of gaming.

There's Vijaye [Raji, VP of entertainment], who's Vivek's manager and also oversees entertainment and video at Facebook. And then we have also the ads side. Our game ad business is massive. They have a seat at the table as well.

The other thing I'd say is that outside that group, interest in gaming rises right to the top. I mean Mark [Zuckerberg] believes in communities, and he goes looking for communities that are strong and upcoming. You have massive communities like religion, nationalities or sports. Gaming is quite large and growing in that list of community groups, and is becoming more social over time.

As you work on new technologies like mixed-reality streaming, would we be more likely to see that first on a service like Twitch or on your own Facebook Gaming platform?

It depends on what the thing is. From a broad, top-level thought process, we want to entertain consumers, and we want to get information about our products out. If the most effective way to do that would be to go to Twitch first, we would probably go to Twitch first. But there are a lot of times where what we want to do isn't available in the marketplace in any form, and the only way the marketplace gets to do it is if we build it ourselves.

And in that case, you want to work with your internal teams, right?

Yeah, because they're the only ones that you can convince to take a flyer on some idea you have that doesn't necessarily make sense either financially, or they just don't believe in it.

So hypothetically, if you wanted to get Call of Duty on Oculus, who would make the call to [Activision Blizzard CEO] Bobby Kotick? Who says, "Hey Bobby, we want Call of Duty on Oculus. What's that gonna cost?"

It certainly wouldn't be me, even though I know a lot of people at Activision, because I'm not in the AR/VR group. It would probably at this point be Mike Verdu who would call and get that communication going.

It might be Boz [Andrew Bosworth, VP of AR/VR], it might be Mark, if they're in the right place at the right time and Mark knows that we're interested in it. Again, that's a hypothetical, but that would be the direction that we would take.

Oculus Home Oculus users could soon have more AAA games to choose from.Photo: Courtesy of Facebook

How important are those AAA, top-quality games in particular for Oculus and for Facebook going forward?

It's important, and specifically important because there's a segment of the gaming market that wants VR and is very interested in VR, but is waiting for VR to have credibility from the few brands that those gamers believe in. And that audience is necessary to get to mass-market, to get to scale. You will see those AAA products. Regardless of who makes the call and what the actual deal is, I think you will see those products.

You all fundamentally believe that you can generate these larger sort of AAA experiences on the onboard Quest hardware and architecture without needing to be plugged in to a computer?

We're going to pull AAA apart for a second. Let's start with the graphic fidelity. It isn't going to happen anytime soon for a portable device to have PC graphics on-headset for simple physics, battery and heat-dissipation reasons.

So if what is meant by AAA is the graphic fidelity of Asgard's Wrath, that's not happening on a local headset, for the same reason that people can't get those games to run on phones and anything else that's battery powered and needs to dissipate heat. You can plug it into a wall, and you can put a liquid-cooled or fan-cooled graphics card in it, and sure. But you can't do that on somebody's face.

There is a way that you can do that on a device and stream it to somebody's face wirelessly, and that probably will happen relatively soon. The problem with that is that's not horribly portable like the Quest is, and what we're finding from consumers is they really want that portability.

In the longer run, and now I'm really waving my hands around and speaking like [Chief Scientist of Facebook Reality Labs] Michael Abrash, there should be ways to stream that from a computer, over your Wi-Fi, to your face. I won't get into the incredible amount of challenges that need to be overcome to get there, but in the long run, that's the way that head-mounted devices end up with AAA-graphic-quality games.

If you get away from the graphic quality for a moment, and you get into the depth of experience, length of experience, craftsmanship of the experience, I think you can get some really big, amazingly deep games onto the Quest platform, and I think you're going to see them in the next year or so. Depending on what we're looking at, it's more a budget/time issue than it is a graphic fidelity/processor issue.

But, again, ultimately we'll throw those processors in a server farm somewhere and stream to your headset. And a lot of people are going to say, "Oh my god, that's a million years away." It's not a million. It's not five. It's somewhere between.

I can tell you this: Nobody is banking on cloud processing making standalone VR headsets viable. We have to make them viable with the chipsets that are in them. But in the long run, cloud solves a lot of problems because it most effectively puts the processing power where it's needed. Now there's latency issues, resolution issues, frame rate issues, tons of issues. And it's a hell of a lot more uncomfortable when it's a frame that's right in front of your face than it is when you miss a frame on a TV that's across the room. So all of these things have to be solved, but no one thinks it's impossible. It's a hypothetical that can be done but it's not coming anytime soon. It is very, very complicated.

When we talk about the potential trajectory of VR as a mass consumer category, some people liken VR to 3D television. Is that a fair comparison?

The answer to that question is simple. 3D television delivered the exact same experience in a way that was interesting, but in the end pretty crappy. So the same movies, the same television shows, maybe a few made-for-3D things because they wanted to show you waterfalls or a forest or something, but ultimately it was watching television with a kind of fake depth. That was its one trick and it was pretty crappy. After watching it for a while, regardless of the technology, your eyes got tired.

And there's a good reason for that, by the way. It wasn't real 3D. You couldn't look around anything. All it was was stereo, and the stereo was made for a very specific interpupillary distance, the distance between your pupils. People's pupils are variable. And some people are wider, most people are in the middle, and then some people are very narrow. And only people that had almost exactly the IPD it was made for got a good experience. Everybody else got a really crappy experience.

VR is an utterly different situation. It's giving you a very, very different experience. VR gets better and better and better every year. VR is an infinitely-evolving ecosystem of totally different content. And so you can't compare the two.

Fintech

Gavin Newsom shows crypto some California love

“A more flexible approach is needed,” Gov. Newsom said in rejecting a bill that would require crypto companies to get a state license.

Strong bipartisan support wasn’t enough to convince Newsom that requiring crypto companies to register with the state’s Department of Financial Protection and Innovation is the smart path for California.

Photo: Jerod Harris/Getty Images for Vox Media

The Digital Financial Assets Law seemed like a legislative slam dunk in California for critics of the crypto industry.

But strong bipartisan support — it passed 71-0 in the state assembly and 31-6 in the Senate — wasn’t enough to convince Gov. Gavin Newsom that requiring crypto companies to register with the state’s Department of Financial Protection and Innovation is the smart path for California.

Keep Reading Show less
Benjamin Pimentel

Benjamin Pimentel ( @benpimentel) covers crypto and fintech from San Francisco. He has reported on many of the biggest tech stories over the past 20 years for the San Francisco Chronicle, Dow Jones MarketWatch and Business Insider, from the dot-com crash, the rise of cloud computing, social networking and AI to the impact of the Great Recession and the COVID crisis on Silicon Valley and beyond. He can be reached at bpimentel@protocol.com or via Google Voice at (925) 307-9342.

Sponsored Content

Great products are built on strong patents

Experts say robust intellectual property protection is essential to ensure the long-term R&D required to innovate and maintain America's technology leadership.

Every great tech product that you rely on each day, from the smartphone in your pocket to your music streaming service and navigational system in the car, shares one important thing: part of its innovative design is protected by intellectual property (IP) laws.

From 5G to artificial intelligence, IP protection offers a powerful incentive for researchers to create ground-breaking products, and governmental leaders say its protection is an essential part of maintaining US technology leadership. To quote Secretary of Commerce Gina Raimondo: "intellectual property protection is vital for American innovation and entrepreneurship.”

Keep Reading Show less
James Daly
James Daly has a deep knowledge of creating brand voice identity, including understanding various audiences and targeting messaging accordingly. He enjoys commissioning, editing, writing, and business development, particularly in launching new ventures and building passionate audiences. Daly has led teams large and small to multiple awards and quantifiable success through a strategy built on teamwork, passion, fact-checking, intelligence, analytics, and audience growth while meeting budget goals and production deadlines in fast-paced environments. Daly is the Editorial Director of 2030 Media and a contributor at Wired.
Workplace

Slack’s rallying cry at Dreamforce: No more meetings

It’s not all cartoon bears and therapy pigs — work conferences are a good place to talk about the future of work.

“We want people to be able to work in whatever way works for them with flexible schedules, in meetings and out of meetings,” Slack chief product officer Tamar Yehoshua told Protocol at Dreamforce 2022.

Photo: Marlena Sloss/Bloomberg via Getty Images

Dreamforce is primarily Salesforce’s show. But Slack wasn’t to be left out, especially as the primary connector between Salesforce and the mainstream working world.

The average knowledge worker spends more time using a communication tool like Slack than a CRM like Salesforce, positioning it as the best Salesforce product to concern itself with the future of work. In between meeting a therapy pig and meditating by the Dreamforce waterfall, Protocol sat down with several Slack execs and conference-goers to chat about the shifting future.

Keep Reading Show less
Lizzy Lawrence

Lizzy Lawrence ( @LizzyLaw_) is a reporter at Protocol, covering tools and productivity in the workplace. She's a recent graduate of the University of Michigan, where she studied sociology and international studies. She served as editor in chief of The Michigan Daily, her school's independent newspaper. She's based in D.C., and can be reached at llawrence@protocol.com.

LA is a growing tech hub. But not everyone may fit.

LA has a housing crisis similar to Silicon Valley’s. And single-family-zoning laws are mostly to blame.

As the number of tech companies in the region grows, so does the number of tech workers, whose high salaries put them at an advantage in both LA's renting and buying markets.

Photo: Nat Rubio-Licht/Protocol

LA’s tech scene is on the rise. The number of unicorn companies in Los Angeles is growing, and the city has become the third-largest startup ecosystem nationally behind the Bay Area and New York with more than 4,000 VC-backed startups in industries ranging from aerospace to creators. As the number of tech companies in the region grows, so does the number of tech workers. The city is quickly becoming more and more like Silicon Valley — a new startup and a dozen tech workers on every corner and companies like Google, Netflix, and Twitter setting up offices there.

But with growth comes growing pains. Los Angeles, especially the burgeoning Silicon Beach area — which includes Santa Monica, Venice, and Marina del Rey — shares something in common with its namesake Silicon Valley: a severe lack of housing.

Keep Reading Show less
Nat Rubio-Licht

Nat Rubio-Licht is a Los Angeles-based news writer at Protocol. They graduated from Syracuse University with a degree in newspaper and online journalism in May 2020. Prior to joining the team, they worked at the Los Angeles Business Journal as a technology and aerospace reporter.

Policy

SFPD can now surveil a private camera network funded by Ripple chair

The San Francisco Board of Supervisors approved a policy that the ACLU and EFF argue will further criminalize marginalized groups.

SFPD will be able to temporarily tap into private surveillance networks in certain circumstances.

Photo: Justin Sullivan/Getty Images

Ripple chairman and co-founder Chris Larsen has been funding a network of security cameras throughout San Francisco for a decade. Now, the city has given its police department the green light to monitor the feeds from those cameras — and any other private surveillance devices in the city — in real time, whether or not a crime has been committed.

This week, San Francisco’s Board of Supervisors approved a controversial plan to allow SFPD to temporarily tap into private surveillance networks during life-threatening emergencies, large events, and in the course of criminal investigations, including investigations of misdemeanors. The decision came despite fervent opposition from groups, including the ACLU of Northern California and the Electronic Frontier Foundation, which say the police department’s new authority will be misused against protesters and marginalized groups in a city that has been a bastion for both.

Keep Reading Show less
Issie Lapowsky

Issie Lapowsky ( @issielapowsky) is Protocol's chief correspondent, covering the intersection of technology, politics, and national affairs. She also oversees Protocol's fellowship program. Previously, she was a senior writer at Wired, where she covered the 2016 election and the Facebook beat in its aftermath. Prior to that, Issie worked as a staff writer for Inc. magazine, writing about small business and entrepreneurship. She has also worked as an on-air contributor for CBS News and taught a graduate-level course at New York University's Center for Publishing on how tech giants have affected publishing.

Latest Stories
Bulletins