Source Code: Your daily look at what matters in tech.
To give you the best possible experience, this site uses cookies. If you continue browsing. you accept our use of cookies. You can review our privacy policy to find out more about the cookies we use.
next-upnext upauthorJanko RoettgersNoneDo you know what's coming next up in the world of tech and entertainment? Get Janko Roettgers' newsletter every Thursday.9147dfd6b1
Subscribe to
Want to better understand the $150 billion gaming industry? Get Shakeel Hashim's newsletter every Tuesday.
Are you keeping up with the latest cloud developments? Get Tom Krazit and Joe Williams' newsletter every Monday and Thursday.
David Wertime and our data-obsessed China team analyze China tech for you. Every Wednesday, with alerts on key stories and research.
Want your finger on the pulse of everything that's happening in tech? Sign up to get David Pierce's daily newsletter.
Do you know what's going on in the venture capital and startup world? Get the Pipeline newsletter every Saturday.
Do you know what's coming next up in the world of tech and entertainment? Get Janko Roettgers' newsletter every Thursday.
Hear from Protocol's experts on the biggest questions in tech. Get Braintrust in your inbox every Thursday.
Get access to the Protocol | Fintech newsletter, research, news alerts and events.
August 24, 2020
Spaces, a VR startup that got its start as a DreamWorks Animation project, has been acquired by Apple, Protocol has learned.
Apple confirmed the acquisition after this story was first published. "Apple buys smaller technology companies from time to time, and we generally do not discuss our purpose or plans," a company spokesperson told Protocol via email, using the company's usual boilerplate statement to confirm startup acquisitions.
Spaces did not immediately respond to a request for comment.
Spaces announced that it was shutting down its existing services last week, telling visitors of its website that it was "heading in a new direction," without revealing further details. "Thank you to our users and partners who participated in our awesome VR video conferencing product and the many people who enjoyed our VR location-based entertainment attractions found at theme parks, theaters, and more," the statement concluded.
Spaces spun out of DreamWorks Animation in early 2016, and developed a range of location-based VR experiences, including "Terminator Salvation: Fight for the Future." The company had to shut down its VR centers at the beginning of the pandemic, laying off some staffers in the process, and took a small PPP loan to keep the lights on. "COVID-19 felt like a tsunami for us," Spaces CEO Shioraz Akmal told Protocol at the time.
Spaces then pivoted to build a VR add-on to traditional video conferencing solutions like Zoom, allowing Zoom users to take part in meetings with an animated avatar. "We like to keep busy making things," Akmal said back then. "We can't sit around waiting a year for something to return."
Apple has been working on its own AR/VR headset for some time and has acquired a number of AR and VR startups to build out its staff for the project. Other recent acquisitions in the space include NextVR, Akonia Holographics and Vrvana. Apple has yet to officially acknowledge plans to launch such a headset.
It's still unclear whether the Spaces team will actually work on VR at Apple. Either way, the exit is a bad omen for the location-based VR industry, which has been struggling to survive through the pandemic. Just last week, news broke that fellow location-based VR startup Sandbox VR had filed for bankruptcy.
Update: This post was updated at 7:40 p.m. PT to include Apple's statement.
From Your Site Articles
- A year after launch, Oculus says Quest is starting a VR revolution ... ›
- Andrew Bosworth on VR's iPhone moment and Facebook's bets ... ›
- Your next office desk is your current desk, but in VR - Protocol ›
- The VR gaming centers of the future may not survive the crisis of today ›
- Why this year’s iPhone launch matters more than most for Apple - Protocol ›
- Walmart shuts down its VR shopping subsidiary Insperience - Protocol ›
- VR filmmakers struggled. Will growing headset sales help? - Protocol — The people, power and politics of tech ›
Janko Roettgers
Janko Roettgers (@jank0) is a senior reporter at Protocol, reporting on the shifting power dynamics between tech, media, and entertainment, including the impact of new technologies. Previously, Janko was Variety's first-ever technology writer in San Francisco, where he covered big tech and emerging technologies. He has reported for Gigaom, Frankfurter Rundschau, Berliner Zeitung, and ORF, among others. He has written three books on consumer cord-cutting and online music and co-edited an anthology on internet subcultures. He lives with his family in Oakland.
Protocol | Fintech
Plaid’s COO is riding fintech’s choppy waves
He's a striking presence on the beach. If he navigates Plaid's data challenges, Eric Sager will loom large in the financial world as well.
Plaid COO Eric Sager is an avid surfer.
Photo: Plaid
March 4, 2021
Benjamin Pimentel ( @benpimentel) covers fintech from San Francisco. He has reported on many of the biggest tech stories over the past 20 years for the San Francisco Chronicle, Dow Jones MarketWatch and Business Insider, from the dot-com crash, the rise of cloud computing, social networking and AI to the impact of the Great Recession and the COVID crisis on Silicon Valley and beyond. He can be reached at bpimentel@protocol.com or via Signal at (510)731-8429.
March 4, 2021
Eric Sager is an avid surfer. It's a fitting passion for the No. 2 executive at Plaid, a startup that's riding fintech's rough waters — including a rogue wave on the horizon that could cause a wipeout.
As Plaid's chief operating officer, Sager has been helping the startup navigate that choppiness, from an abandoned merger with Visa to a harsh critique by the CEO of a top Wall Street bank.
<p>But things have been breaking nicely for Plaid during the COVID-19 crisis, which has let the company really charge. </p><p>Plaid, which is based in San Francisco and has more than 600 employees, charges financial apps for a service that helps consumers verify and connect their bank accounts, a key step for moving and managing their money. It also, controversially, pulls transaction data from those newly connected accounts and sells insights based on that information.</p><h3>Surfer-in-chief</h3><p>Plaid's surfer-in-chief describes the customer base as a series of waves.</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="1">
</div>
</div></p><p>"The first wave is the core fintech companies — the Robinhoods, the Venmos, the Squares, the Chimes," he said, noting how these "early fintechs are getting more and more successful."</p><p>"The second wave [composed of] banks and financial institutions are rapidly moving to digitize. … The third wave are the Googles, the Apples, the Lyfts, the Teslas. Everybody is moving towards building digital financial services."</p><p>"We're riding all three of those," he added. "If anything keeps me up at night it's making sure that we continue to kind of scale the business."</p><p>Sager admits that, as a surfer bro, he can be an intimidating presence at the beach.</p><p><br></p><p class="shortcode-media shortcode-media-rebelmouse-image">
<a href="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yNTcxMzc4NC9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTY1ODQ1Mjc4NX0.2-3V-Md9VtATd0QhCvcc6VFQNXuu7_reFyIPjdEVuAA/img.jpg?width=980" target="_blank"><img type="lazy-image" data-runner-src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yNTcxMzc4NC9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTY1ODQ1Mjc4NX0.2-3V-Md9VtATd0QhCvcc6VFQNXuu7_reFyIPjdEVuAA/img.jpg?width=980" id="3c170" class="rm-shortcode" data-rm-shortcode-id="4978fb31443a663192df9fc1643a9eb4" data-rm-shortcode-name="rebelmouse-image"></a>
<small class="image-media media-caption" placeholder="Add Photo Caption...">Sager with wife Melissa Miao.</small>
<small class="image-media media-photo-credit" placeholder="add photo credit...">Photo: Plaid</small>
</p><p><br></p><p>"I'm 6'8", I have a 10-foot-board and my family has a history of skin cancer, so I go out there with a hat," he told Protocol. "So all the little kids that are surfing always make fun of me. But once I'm on the wave, all the short boarders get out of the way."</p><p>Plaid's latest charge is toward payroll data. On Thursday, the company unveiled a new product that would make it easier to verify employee income for different financing needs, including securing a loan, applying for a mortgage or leasing a car. </p><p>Plaid is supporting real-time payroll authentication for more than 250,000 of the largest employers in the U.S., which the company estimates makes up to 60% of the total working population. </p><p>"It was something we heard a lot from customers who were being asked to verify income and so forth," Sager said. "Every single lending customer we have would love to have this information for the exact same reason that it makes the onboarding flow easier."</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="2">
</div>
</div></p><p>Melody Brue, analyst with Moor Insights & Strategy, said the new offering could "open up so many possibilities for employers, lenders, neobanks — pretty much everyone in the fintech ecosystem." </p><p>"Access to payroll data can change the way lenders look at underwriting and servicing loans and significantly cut costs and time spent on verification," she told Protocol. </p><h3>'A blessing in disguise'</h3><p>It's Plaid's first major product rollout since the collapse of merger talks with Visa. Brue called <a href="https://www.protocol.com/plaid-visa-deal" target="_self">the scuttling of the deal</a> "a blessing in disguise" after Plaid saw stronger demand for its infrastructure in the COVID-19 crisis. The company, which has raised $310 million in funding from investors that include Goldman Sachs, Citi Ventures and Visa, was last valued at $5.3 billion. That has <a href="https://www.theinformation.com/articles/plaid-shareholders-field-offers-at-15-billion-after-merger-collapse" rel="noopener noreferrer" target="_blank">reportedly jumped to $15 billion</a> following the collapse of the Visa deal.</p><p>But Plaid's latest product offering, she said, will also likely make it more of a target: "This will likely be seen as a threat to financial institutions, as they already fear security issues from open banking and now may fear losing customers."</p><p>Plaid emerged as a powerhouse by providing banks and financial startups real-time access to consumer financial data, such as bank and investment accounts. Plaid, whose services integrate with 11,000 financial institutions, has more than 4,000 customers, including Square, PayPal, Robinhood, SoFi and Affirm.</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="3">
</div>
</div></p><p>But Plaid has taken fire for the way it manages financial data. "Plaid has irritated a lot of the banks," Logan Allin, managing general partner and founder of Fin Venture Capital, told Protocol. "You heard Jamie Dimon saying Plaid's playing dirty, right?"</p><p>He was referring to the <a href="https://www.cnbc.com/2021/01/15/jamie-dimon-says-jpmorgan-chase-should-absolutely-be-scared-s-less-about-fintech-threat.html" rel="noopener noreferrer" target="_blank">JPMorgan Chase CEO's remark</a> on a call with analysts calling out "people who improperly use data that's been given to them, like Plaid." Dimon's remarks came despite a 2018 agreement the companies signed that they said would "protect customer data."</p><p>Plaid also faces a class action lawsuit filed by a consumer, accusing the company of using deceptive and misleading data practices.</p><p>"Imagine there is a company that knows every dollar you deposit or withdraw, every dollar you charge or pay to your credit card and every dollar you put away for retirement, within hours after you make the transaction," <a href="https://www.courtlistener.com/recap/gov.uscourts.cand.361471/gov.uscourts.cand.361471.1.0.pdf" rel="noopener noreferrer" target="_blank">the lawsuit filed on behalf of California resident</a> Logan Mitchell began. "Imagine that, as far as you know, you never provided your username and password to this company or otherwise authorized it to access your online accounts."</p><p>The lawsuit argued that Plaid "acquired its mountain of consumer data by deceiving consumers into giving Plaid the key to their financial lives: their bank usernames and passwords." It accused the startup of committing "fraud by erecting a sophisticated edifice of deceit to trick users into thinking that they are logging into their financial institutions, when in fact they are turning over their credentials to Plaid."</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="4">
</div>
</div></p><p>Sager declined to comment on the lawsuit or Dimon's remarks. But he said Plaid has built features meant to give consumers control over their data. "If you're a consumer, you can log on to a dashboard, you can see every single connection you've ever made, you can permission and un-permission that information."</p><h3>Debate over data access</h3><p>However, critics, including some fintechs, argue that Plaid does not offer enough clear and convenient opportunities for consumers to opt out of having their data accessed. Yves-Gabriel Leboeuf, CEO and cofounder of Flinks, a Plaid rival based in Montreal — it's been called the "Canadian Plaid" — would not comment directly about Plaid, but he said consumer consent in fintech data aggregation is a serious issue. </p><p>"The bad data practices that we've seen in the market are practices where there will be an ongoing aggregation of the data on a daily basis, without having expressly giving the consent to do so," he told Protocol. "Our thesis is that that's not Flinks' data, that's the consumers' data. And we have no right to use that data, unless it's clear that they are giving us that right."</p><p>Steve Smith, CEO of Finicity, another Plaid rival which was recently acquired by Mastercard, also emphasized the need for "full transparency" in the way consumer financial data is accessed. He stressed the importance of "bringing down the walled garden of data, but doing it in a very responsible way."</p><p>"I can't speak to Plaid's specific data governance policy or Yodlee's specific data governance policy," Smith told Protocol, referring to another major data aggregator which has <a href="https://www.reuters.com/article/dataprivacy-envestnet-yodlee/envestnet-yodlee-seek-dismissal-of-privacy-lawsuit-over-financial-data-collection-idUSL1N2HR39K" rel="noopener noreferrer" target="_blank">also been sued for its data collection practices</a>. "Clearly, I think you'll find differences between the three organizations and the way they view data or the way they approach this conversation."</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="5">
</div>
</div></p><p>Sager stressed that making all that data accessible to banks and fintechs has been a game changer for many consumers. "A lot of the innovation fintech is helping address is suddenly people are getting products that they previously weren't able to get," he said.</p><p>His views were shaped by an unusual career. Born and raised in Germany, he moved to the U.S. as a high school exchange student. He had hoped to go to California or Hawaii, for the surfing spots, but the program sent him instead to Mississippi where he also went to college.</p><p>His first job after graduation was with Capital One. He was part of a team at the credit-card issuer that ran tests to evaluate the effectiveness of direct mail campaigns. "What's the difference in response rate if the letter is blue versus pink versus white?" he said. "What's the difference in response rate if the font on the APR is 10 points versus 12 points? There's just nothing we didn't test."</p><p>That included the unorthodox, and legally dubious idea, of putting a dollar bill inside promotional mailers. That didn't sit well with Capital One's management, who promptly told them to shut it down.</p><p>"Well, I didn't put it in there myself," Sager said of the dollar bill scheme, laughing. "The results were good, but it's obviously not the kind of thing you want to be doing at scale so we shut that down. It was my first job. I was 22 and it was probably not the best judgment call."</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="6">
</div>
</div></p><p>He subsequently got an MBA from Harvard before working at Bain. He then plunged into the fintech world, first as head of sales at Square, then as chief revenue officer at BlueVine, a small business-financing startup. <em>[Disclosure: This reporter worked with Sager at BlueVine.]</em></p><p>When he joined Plaid as COO in 2019, it was a challenging transition. Plaid was six years old, and still growing quickly. He was the new guy, and he didn't want to screw things up.</p><p>For the first time in his executive career, Sager said, he was leading a team that he didn't help build from the ground up. He was used to being one of the most experienced people in the room.</p><p>"I was used to saying, 'Hey, I built this. I actually was there when we built it from zero to one or from one to two,'" he said. "Suddenly, you're in a world where it's already at 10. It was already a big, successful company. Suddenly, you're in a situation where you're going literally all day long talking to somebody else and they know way more, but they're still looking to you as if you should have some unique insight. It will make you feel dumb very quickly."</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="7">
</div>
</div></p><p>Charley Ma, who was a growth manager at Plaid when Sager joined the startup and is now a general manager at Alloy, remembered him as an effective leader. "He's very German, very direct, which I like," he told Protocol. </p><h3>Democratizing finance</h3><p>Brue of Moor Insights & Strategy said Sager has become instrumental in "driving the company" in the direction of "actually democratizing finance. The company is giving people access to financial services they've previously been excluded from."</p><p>That approach was influenced by Sager's early years in the U.S.. His first credit card after moving to the U.S. from Germany had an APR of roughly 30%, he said. "I just didn't have a good credit score because I just had never been part of the U.S. system," he said. "Don't get me wrong. Nobody should feel sorry for me. I had a good job and I could find other ways of doing it."</p><p>"But think about how many people in the U.S. aren't in that position — they don't have the history, they can't get loans or they have to get really really expensive loans. You're in a bad cycle. You're trying to take care of your family. You're forced to take high-interest loans. Now you have to work to pay off the high-interest loans and before you know it, you end up in a very negative spiral."</p><p>Fintech is helping fix this, he said. Broader data access is making it possible to offer better financing to more consumers, including those who may not have what's traditionally considered stellar credit. "At the end of the day right, better data means better underwriting," Sager said.</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="8">
</div>
</div></p><p>In fact, having more data could have improved the work he did at Capital One, he said: "If we just had some of the data that we now have, we would have been able to make much better decisions. We would have been able to offer people much lower rates."</p><p>"It's not impossible" for a consumer to provide more data then or now, he said. "The other version 10 years ago would have been you asked for all the bank statements, I go print them out, I put them in the mail or I go go to the office and drop them off and you work through all that. It's not like it couldn't be done, but it's about removing the friction."</p><p>Sager acknowledged that data access has become a "flashpoint" in financial services. Banks and other traditional financial institutions have been <a href="https://www.protocol.com/fintech/cfpb-banks-financial-data" target="_self">resisting calls to make consumer data</a> they collect and hold more accessible to new financial players. </p><p>Leboeuf, the Flinks CEO, said it's a debate in which his company and others are aligned with Plaid: "I do think that the best approach is driven by Plaid and Flinks because ultimately we are working for the best interests of the applications and the consumers."</p><p>Sager echoed that view, saying: "At the end of the day, it's the consumer's data. Whoever you've been banking with, it's your data and you should have the same rights to that data digitally as you would if you were to print out your bank statement, if you wanted to use that to get a car loan, if you wanted to use that to input that information manually into an Excel spreadsheet so you could do your budgeting — whatever it is, it's the consumers' data."</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="9">
</div>
</div></p><p>It's the view Sager hopes will prevail as Plaid gears up for that swell on the horizon. Will Sager get a clean ride — or will Plaid find itself locked in?</p>
Keep Reading
Show less
Benjamin Pimentel ( @benpimentel) covers fintech from San Francisco. He has reported on many of the biggest tech stories over the past 20 years for the San Francisco Chronicle, Dow Jones MarketWatch and Business Insider, from the dot-com crash, the rise of cloud computing, social networking and AI to the impact of the Great Recession and the COVID crisis on Silicon Valley and beyond. He can be reached at bpimentel@protocol.com or via Signal at (510)731-8429.
Sponsored Content
The future of computing at the edge: an interview with Intel’s Tom Lantzsch
An interview with Tom Lantzsch, SVP and GM, Internet of Things Group at Intel
February 28, 2021
Saul Hudson has a deep knowledge of creating brand voice identity, especially in understanding and targeting messages in cutting-edge technologies. He enjoys commissioning, editing, writing, and business development, in helping companies to build passionate audiences and accelerate their growth. Hudson has reported from more than 30 countries, from war zones to boardrooms to presidential palaces. He has led multinational, multi-lingual teams and managed operations for hundreds of journalists. Hudson is a Managing Partner at Angle42, a strategic communications consultancy.
February 27, 2021
An interview with Tom Lantzsch
Senior Vice President and General Manager of the Internet of Things Group (IoT) at Intel Corporation
Edge computing had been on the rise in the last 18 months – and accelerated amid the need for new applications to solve challenges created by the Covid-19 pandemic. Tom Lantzsch, Senior Vice President and General Manager of the Internet of Things Group (IoT) at Intel Corp., thinks there are more innovations to come – and wants technology leaders to think equally about data and the algorithms as critical differentiators.
In his role at Intel, Lantzsch leads the worldwide group of solutions architects across IoT market segments, including retail, banking, hospitality, education, industrial, transportation, smart cities and healthcare. And he's seen first-hand how artificial intelligence run at the edge can have a big impact on customers' success.
Protocol sat down with Lantzsch to talk about the challenges faced by companies seeking to move from the cloud to the edge; some of the surprising ways that Intel has found to help customers and the next big breakthrough in this space.
What are the biggest trends you are seeing with edge computing and IoT?
A few years ago, there was a notion that the edge was going to be a simplistic model, where we were going to have everything connected up into the cloud and all the compute was going to happen in the cloud. At Intel, we had a bit of a contrarian view. We thought much of the interesting compute was going to happen closer to where data was created. And we believed, at that time, that camera technology was going to be the driving force – that just the sheer amount of content that was created would be overwhelming to ship to the cloud – so we'd have to do compute at the edge. A few years later – that hypothesis is in action and we're seeing edge compute happen in a big way.
<p>The last 18 months have been a wild time to be in technology. We've seen edge compute come to life to help businesses adapt during the pandemic. At the same time, we are also seeing how 5G is going to drive up interest, especially from a networking perspective, rather than a use-case perspective. We also see lot of people that are focused on their data, but the <em>algorithms</em> that companies train with the data are going to be their critical assets. It doesn't matter what company or what industry; <em>this</em> will really become the differentiator for many companies.</p><p>And particularly amid the backdrop of the pandemic, we've seen how companies are using technology to either bring workers back in safely or <a href="https://www.intel.com/content/www/us/en/corporate-responsibility/covid-19-response-sensormatic-article.html" target="_blank">serve their customers in new ways</a>, <a href="https://www.intel.com/content/www/us/en/customer-spotlight/stories/brentwood-academy-customer-spotlight.html" rel="noopener noreferrer" target="_blank">educate children in new ways</a> -- all things that have accelerated the digital transformation that had been underway. I recently read a <a href="https://www.mckinsey.com/business-functions/strategy-and-corporate-finance/our-insights/how-covid-19-has-pushed-companies-over-the-technology-tipping-point-and-transformed-business-forever" rel="noopener noreferrer" target="_blank">McKinsey survey</a> that reported on the "speedup in creating digital or digitally enhanced offerings. Across regions, the results suggest a seven-year increase, on average, in the rate at which companies are developing these products and services."</p><p>And based on what we're seeing at Intel, those are lifesaving and industry saving investments happening today – completely re-designing the way that <a href="https://www.intel.com/content/www/us/en/corporate-responsibility/covid-19-response-mic-article.html" rel="noopener noreferrer" target="_blank">patients are treated</a>, and businesses operate.</p><h4>What are you particularly expecting to see this year?</h4><p>What I find most interesting is the work that combines IoT with networking capabilities – and I think this is going to be a year of expansive exploration and working with our customers to put these two things together to solve real business challenges.</p><p>When we first started the integration of networking technology and operational technology capabilities and layered that across the industry verticals, we could count the amount of interested customers and opportunities on one hand. Last year, it was five times that many and this year we see that number increasing significantly already. So, we're excited to see the industry continue to build excitement to scale those types of deployments.</p><h4>What role does AI play at the edge and in what way is Intel involved?</h4><p>An AI use case recently grabbed my attention: employees in a restaurant being screened by a device that checks temperature while the employees are washing their hands – and provides a determination on whether they'd done it adequately before they report to work. I have seen other applications using similar technology in the <a href="https://marketplace.intel.com/s/offering/a5b3b000000TiMSAA0/using-ai-to-make-construction-site-safer?language=en_US" rel="noopener noreferrer" target="_blank">construction industry</a>, where an AI algorithm scans to see if employees have their helmet, goggles, vest and other safety equipment on properly to determine if they are ready to work. And the best part is – that the employer can see aggregate data on these interactions to determine if more training on handwashing or helmet wearing is needed.</p><p>At Intel, in addition to providing the fundamental base technology to enable these applications, we work with a lot of third-party developers to create these applications. And we help the developers scale them across multiple industries with our salesforce. So, we may not make the scan technology that determines if you have the right gear on, but we orchestrate that coordination across our ecosystem with all of our partners to effectively put it into a <a href="https://marketplace.intel.com/s/?language=en_US" rel="noopener noreferrer" target="_blank">catalog</a> so that if customers are interested in that sort of application, we can provide them with different parties to make that happen.</p><h4>Is there a problem with fragmentation in the market and how can that be solved?</h4><p>It's very fragmented. I gave just two examples of totally different workers coming to work in different industries and I can give you five more that are different again. Although the base technology that Intel creates to enable this type of innovation is very horizontal in nature, the reality is that bringing those to life must be very "vertically-centered" and very "use-case centered" – and must take into account, geography. The two employee use cases I cited look very different if you are talking about employees in North America, India or Germany. So, all in all, this is a holistic ecosystem challenge – and an ecosystem solution.</p><p>At Intel, we're in a unique situation to orchestrate these solutions. </p><p><cite class="pull-quote">People tend to think of Intel as providing the technical footprint that enables edge computing – but we also have the developer reach – and we can use our ecosystem and scale to help our end customers get access to the best solutions.</cite></p><h4>What sort of challenges do customers face when they're attempting to adopt edge computing?</h4><p>There are two common challenges. One is the technical question of 'Who can I work with?' A customer may have a chip focus but actually, it's a more complex question than a chip. We like that complexity, because we can be an adviser to them and <a href="https://marketplace.intel.com/s/partners-by-industry?language=en_US" rel="noopener noreferrer" target="_blank">bring to the table partners</a> that they can work with to solve that complexity leveraging our technical knowledge and ecosystem network. </p><p>The second thing that companies struggle with is the challenge of how to fund getting into this space – even if the business case warrants the investment. The world has changed. Companies don't want to write a big capital check for these types of investments – they want a pay-as-you-go model, like you see with the cloud. We've been working with customers to find a way to make that happen – and I think that is going to be a bigger part of the conversation moving forward.</p><p>You can see it across almost every aspect of technology now. We rent compute more than we buy compute. Evidenced by the success of AWS, companies can rent compute from Amazon instead of building their own data center – and there are many benefits to that approach. In the old world, even for this video conference that we're having today we would have installed capital to do this. Now it's just a service. And I think that edge as a service is right around the corner.</p><h4>Do you have an example of that?</h4><p>A customer in Mexico wanted to deploy outdoor WiFi and add security features into it. So, it was an edge-based computing issue that was part connectivity. But there was actually way more to it than just installing it. We not only helped to solved the technological challenge creatively and coordinated the <a href="https://marketplace.intel.com/s/partners-by-industry?language=en_US" rel="noopener noreferrer" target="_blank">ecosystem of providers</a> to solve this, but we also found a way so that the customer could get into this market with a service-based model without needing to outlay a lot of capital.</p><p>Other semiconductor companies would have a difficult time partnering on both sides of that challenge, but Intel can do it because we have the scale.</p><h4>How do businesses identify which functions they do want to perform at the edge versus in the cloud?</h4><p>It really comes down to a question of what you're trying to do and how you do it at the lowest cost, highest quality and standard in computability.</p><p>If you have an application and it can perform what you need it to do in the cloud, you'll probably run it there. The cloud is a great thing - there's infinite compute and lots of choice in a well-understood developer environment.</p><p>But there are many things you can't or shouldn't do in the cloud for certain reasons. Take the camera example from earlier. Say you have eight high-density cameras, and you want an action on them immediately. You may not be able to afford the latency that comes with going up into the cloud. Or it may be a financial challenge – that its actually more expensive to send that data to the cloud over and over again, and it makes sense to invest in compute at the edge. There are nuances in the decision-making. It really comes down to what you want the application to do, how quickly and how much it should cost.</p><h4>How does Intel help developers to learn, to build and then test their solutions at the edge?</h4><p>To enable what we know to be interesting and challenging use cases at the edge, required us to change our focus on who these developers are and what they care about. We learned that they <em>really</em> don't care about what hardware they're running on. The modern developers are fairly well extracted from the hardware – they just assume the compute is going to be available for them to do their work.</p><p>To make sure we can deliver on that, we typically target developers by specific capability. The most advanced case that we've been studying on the edge recently is focused video and specifically, video inferencing and AI inferencing. We created a tool called <a href="https://software.intel.com/content/www/us/en/develop/tools/openvino-toolkit.html" rel="noopener noreferrer" target="_blank">OpenVINO</a>, which was developed in a way that developers didn't have to care about the hardware it runs on. It's a model optimization technology that enables them to easily scale out to different hardware platforms. That's proven to be an interesting value proposition to these developers.</p><p>Our goal with <a href="https://software.intel.com/content/www/us/en/develop/tools/openvino-toolkit.html" rel="noopener noreferrer" target="_blank">OpenVINO</a> is democratize AI activity and inference at the edge. We want to make it simple -- to put these tools in the hands of non-data scientists and make it work. As a part of that process, we're also creating an environment where they can develop anyplace, anytime, anywhere they want to be. We're so proud of our <a href="https://software.intel.com/content/www/us/en/develop/tools/openvino-toolkit.html" rel="noopener noreferrer" target="_blank">OpenVINO</a> community and are constantly working to grow the community and release new features and capabilities to edge developers.</p><h4>What's the possible next breakthrough that you see for Intel in edge computing and the IoT space?</h4><p>I'm looking forward to the big breakthrough when we show integrated 5G, Virtual Private Network and the edge workloads all in one unit. More to come.</p>
Keep Reading
Show less
Saul Hudson has a deep knowledge of creating brand voice identity, especially in understanding and targeting messages in cutting-edge technologies. He enjoys commissioning, editing, writing, and business development, in helping companies to build passionate audiences and accelerate their growth. Hudson has reported from more than 30 countries, from war zones to boardrooms to presidential palaces. He has led multinational, multi-lingual teams and managed operations for hundreds of journalists. Hudson is a Managing Partner at Angle42, a strategic communications consultancy.
Power
Google wants to help you get a life
Digital car windows, curved AR glasses, automatic presentations and other patents from Big Tech.
A new patent from Google offers a few suggestions.
Image: USPTO
February 28, 2021
Mike Murphy ( @mcwm) is the director of special projects at Protocol, focusing on the industries being rapidly upended by technology and the companies disrupting incumbents. Previously, Mike was the technology editor at Quartz, where he frequently wrote on robotics, artificial intelligence, and consumer electronics.
February 28, 2021
Another week has come to pass, meaning it's time again for Big Tech patents! You've hopefully been busy reading all the new Manual Series stories that have come out this week and are now looking forward to hearing what comes after what comes next. Google wants to get rid of your double-chin selfie videos and find things for you as you sit bored at home; Apple wants to bring translucent displays to car windows; and Microsoft is exploring how much you can stress out a virtual assistant.
And remember: The big tech companies file all kinds of crazy patents for things, and though most never amount to anything, some end up defining the future.
<h3>Alphabet</h3><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10929982&IDKey=D2992D61B62A%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D13%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dgoogle.ASNM.%2526OS%3DAN%2Fgoogle%2526RS%3DAN%2Fgoogle" rel="noopener noreferrer" target="_blank"><strong>Making selfies look better</strong></a></p><p>Perhaps even before our lives were dominated by video calls, you might've noticed when someone just couldn't figure out where to place their camera. Generally, anything below eye height is going to lead to some unflattering angles, but if you're also on a phone, holding your device up that long can get tiring. Google is apparently trying to solve this with AR: According to this patent, it's looking into using the depth sensors found on the front of many smartphones to re-create your face in video calls at a more flattering angle, to reduce what the pattern calls "the big nose effect." I'm here for this concept, but also Google's depiction of what it's trying to eliminate:</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="1">
</div>
</div></p><p><img src="https://lh5.googleusercontent.com/lYYEYZ52NjuL8M2BnrKVI80huN6UBNYEl1sFEScg5s5MdKrv8n2pBlI3tqXw3ooNJh8h2fWLTeTQaI4TrETMRu-E8ld49QGy3U783TOD8k8WMIR0lPZBAlCih9p3NU4U2sOEqtuI"></p><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10929885&IDKey=AFA7541891BF%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D16%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dgoogle.ASNM.%2526OS%3DAN%2Fgoogle%2526RS%3DAN%2Fgoogle" target="_blank"><strong>Jamming more ads into Maps</strong></a></p><p>Google Maps has become increasingly beset with ads in recent years, with promoted pins and locations on various instances of Maps. But this patent, which determines how Google goes about valuing ads in Google Maps — it, shockingly, has a lot to do with location — shows that the company might be looking at turning every part of the world into a digital version of Times Square, by displaying ads in-between the streets on a map. Hopefully it doesn't feel the need to run ads in <em>all</em> these potential slots at once, as that might make it rather difficult to navigate: </p><p><img src="https://lh6.googleusercontent.com/JcWTDCLxLAIEnhwl__JCNqeGm5ivedVoZVx_t83zGUntlZdU2H3CeQm9L3RC7QEZ_Cbb1n8B-bq_B-UJoATR2JiehxRwlA_O9GgO2BcEsph9C2cMPihvsdIWJlG9iJfvo4hTmLG9"></p><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10929486&IDKey=8946337F7961%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D23%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dgoogle.ASNM.%2526OS%3DAN%2Fgoogle%2526RS%3DAN%2Fgoogle" target="_blank"><strong>Outsourcing having a life to AI</strong></a></p><p>It's tough to do things, I know. Many days, even before the pandemic, I was content to just sit on the couch all day watching TV and ordering takeout. But Google is apparently looking into outsourcing to a virtual assistant the task of making sure you actually get your butt off the sofa. The patent outlines an assistant that could suggest things to do, as well as where and when to do them, based on the user's preferences. It could also suggest things to do that your friends or other users have enjoyed doing. Some of the suggestions aren't exactly things I'd consider a hobby, though: choosing "fight off a cold" as an activity is a really odd way to want to pass the time. <img src="https://lh4.googleusercontent.com/uHktu_DhtqRY9P68bJLJeoFceXUWTrtEeTN7xB6hiBFWxiCY5FDqrZW0zGkqlssZ481nmrNba9nGYXrsdfEk0eTsG64QXV37qaAfQ51BYGhs5DlwKuNJiA2WI5uGtQaLcOS_INsS"></p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="2">
</div>
</div></p><h3>Amazon</h3><p><a href="http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=27&f=G&l=50&co1=AND&d=PTXT&s1=amazon.ASNM.&OS=AN/amazon&RS=AN/amazon" target="_blank"><strong>Searching using loyalty programs</strong></a></p><p>When you search for things online, you're generally only shown the prices for things that everyone sees. But if you're a member of a loyalty program, you might often get discounts or other benefits that could make some products cheaper or more attractive. Amazon's patent outlines a search engine that can store which loyalty programs you're a part of, and show any deals associated with that membership that businesses might be running. This could be useful for finding deals at partners of loyalty programs that you might not be aware of, but if you're already loyal to one hotel or airline brand, you're probably going to search them first before doing a general search. </p><p><img src="https://lh3.googleusercontent.com/XSeV507IoB60vuP-AKADzUQH3OCfoDarf4Ahdgo0kNH-YxVe6qj-MRv9dfGECwElzPftQ3dJfMBeJq5fEEaqcAR6cyprVeBF99cienf2ipJGV35gR5LrTL8RVSOqAHqtqKrMX6Et"></p><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10929810&IDKey=0F7C251F2619%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D23%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Damazon.ASNM.%2526OS%3DAN%2Famazon%2526RS%3DAN%2Famazon" target="_blank"><strong>Indoor drones</strong></a></p><p>Amazon has been making waves for years about using autonomous drones for delivering orders, but to date, it hasn't gotten much traction. It seems, according to this patent, to be turning its attention at least partly to a less-regulated bit of airspace: indoors. The patent explains how autonomous drones, fitted with cameras and sensors, could be used to inspect inventory stored in the bins in the company's massive, high-ceilinged warehouses. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="3">
</div>
</div></p><h3>Apple</h3><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10928697&IDKey=B939F26801A6%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-adv.htm%2526r%3D51%2526f%3DG%2526l%3D50%2526d%3DPTXT%2526s1%3D%252522apple%252Binc%252522.ASNM.%2526p%3D2%2526OS%3DAN%2F%252522apple%252Binc%252522%2526RS%3DAN%2F%252522apple%252Binc%252522" target="_blank"><strong>Smart tinted windows</strong></a></p><p>This feels like a concept you'd see in sci-fi films set in a future where people have time to kill in the back of a self-driving car. Instead of staring at their phones, the sunroof and windows tint black, and news programs or views of scenic landscapes would replace whatever dystopian cityscape the car is driving through. It seems that Apple is looking into turning this into a reality, by creating see-through glass panes embedded with LEDs and other light sources that could change the color of the glass and allow information to be displayed on it. Pair that with the AR maps it was working on from <a href="https://www.protocol.com/alphabet-eat-balloons" target="_self">last week</a>, and you could have a whole new way of looking at driving on your hands. </p><h3>Facebook</h3><p><a href="http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=29&f=G&l=50&co1=AND&d=PTXT&s1=facebook.ASNM.&OS=AN/facebook&RS=AN/facebook" rel="noopener noreferrer" target="_blank"><strong>Curved-lens AR glasses</strong></a></p><p>This feels a little bit like the walking-around version to Apple's patent above. Most AR headsets use cameras to portray information on flat surfaces in front of your eyes. If you're like me and wear giant glasses that make you look like an owl, that might be fine, as your entire field of view is covered by lenses, but this patent explores adding AR to the periphery as well. The glasses in the patent have lenses that curve around the side of the frames so that they can overlay information on your peripheral view, which could make the experience of augmenting reality feel a little less jarring. That said, you would have to go out in public wearing something that looks like this: </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="4">
</div>
</div></p><p><img src="https://lh6.googleusercontent.com/YQudRSE9rpgmW6sFYiOU7-fK_tijuGQMxUhPKBq9cQWjmapgqPuV-K2FKAb-C_mlGqBmzOeFisYN3K2JLXqjzmvJzsHuEwfPo-_-CiIodnZg-alfFF1wsw74xVkb5nNaTx-pU71_"></p><h3>Microsoft</h3><p><a href="http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=36&f=G&l=50&co1=AND&d=PTXT&s1=microsoft.ASNM.&OS=AN/microsoft&RS=AN/microsoft" target="_blank"><strong>Automatic presentation controls</strong></a></p><p>If you've ever watched a presentation from a major tech company and wondered how they nailed the timing on slide changes so well … it's probably because they've rehearsed it a thousand times and have someone whose job it is just to press forward on the slide at the right time. But if you don't have that luxury at your disposal, you might find the ideas in this patent helpful. Microsoft is exploring presentation software that would be able to listen for cues in your speech to detect that you've gotten to the end of one slide, and move you automatically on to the next. It also suggests doing a training run, where the user runs through their presentation, manually clicking where they want to change slides, and the system would record that and do it automatically when they go to present. I'm not sure about having to have something listen to me at all times to get this to work, but it'd make presentations a lot less awkward than the "please can you click to the next slide, no, not the last slide, the next one" that often happens. </p><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10931607&IDKey=7B2CDAAF4E95%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D19%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dmicrosoft.ASNM.%2526OS%3DAN%2Fmicrosoft%2526RS%3DAN%2Fmicrosoft" rel="noopener noreferrer" target="_blank"><strong>Getting angry at virtual assistants to get results</strong></a></p><p>Stressing other people out when you're in charge is a very easy, albeit not very amenable, way to get stuff done. If you're having a conversation with someone and they stress to you, "I <em>need</em> you to get this back to me by end of day," and you know that they are ultimately the person who could end your employment, you're very likely going to get it back to them soon, unless you don't want to work there anymore. It's a lot harder to convey emotion and stress like that to a digital assistant, but this patent is exploring being able to understand human intonation and emotion in requests, such as a user stressing that they need to get a meeting scheduled with someone by the end of the week, which the AI would interpret as it being an urgent meeting when looking for time to schedule. Hopefully when the robot uprising comes, they'll not be too annoyed at us taking them for granted as digital PAs. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="5">
</div>
</div></p><p><img src="https://lh6.googleusercontent.com/CHYmBNr1k8asJ9p8zi43L-PaaZ5dYVTxgP5mblcY4OmjXw5YoLRZQxZCLBJPDurDGO1QQyCe4_A__MUCFgfubokFtskr7qHjgZOHlsv76dvmVtv7P6iWpys6pqmMrroiPNrIkPi0"></p>
From Your Site Articles
Keep Reading
Show less
Mike Murphy ( @mcwm) is the director of special projects at Protocol, focusing on the industries being rapidly upended by technology and the companies disrupting incumbents. Previously, Mike was the technology editor at Quartz, where he frequently wrote on robotics, artificial intelligence, and consumer electronics.
Transforming 2021
Blockchain, QR codes and your phone: the race to build vaccine passports
Digital verification systems could give people the freedom to work and travel. Here's how they could actually happen.
One day, you might not need to carry that physical passport around, either.
Photo: CommonPass
February 23, 2021
Mike Murphy ( @mcwm) is the director of special projects at Protocol, focusing on the industries being rapidly upended by technology and the companies disrupting incumbents. Previously, Mike was the technology editor at Quartz, where he frequently wrote on robotics, artificial intelligence, and consumer electronics.
February 23, 2021
There will come a time, hopefully in the near future, when you'll feel comfortable getting on a plane again. You might even stop at the lounge at the airport, head to the regional office when you land and maybe even see a concert that evening. This seemingly distant reality will depend upon vaccine rollouts continuing on schedule, an open-sourced digital verification system and, amazingly, the blockchain.
Several countries around the world have begun to prepare for what comes after vaccinations. Swaths of the population will be vaccinated before others, but that hasn't stopped industries decimated by the pandemic from pioneering ways to get some people back to work and play. One of the most promising efforts is the idea of a "vaccine passport," which would allow individuals to show proof that they've been vaccinated against COVID-19 in a way that could be verified by businesses to allow them to travel, work or relax in public without a great fear of spreading the virus.
<p><div class="ad-tag"><div class="ad-place-holder" data-pos="1">
</div>
</div></p><p>But building a system that everyone agrees with — and can access — is no small task. There are several companies working on competing projects to verify vaccinations. But beyond that, there are more than a few hurdles that could prevent vaccine passports from succeeding, from antiquated medical records systems to interoperability issues and privacy concerns. Here's how they could actually succeed. </p><h3>Competing projects, similar standards</h3><p>Pretty much since the first blockchain white paper, people have been looking for perfect examples of where a distributed, immutable ledger could be valuable. There's obviously the push to use it for currencies, and companies have tried to use it for things like tracking <a href="https://www.protocol.com/ibm-blockchain-supply-produce-coffee" target="_self">food production</a> and <a href="https://www.govtech.com/products/Blockchain-Voting-Debate-Heats-Up-After-Historic-Election.html" rel="noopener noreferrer" target="_blank">voting</a>, but there are few use cases that have truly taken off, at least so far. "We've been working on this since 2014; we never thought that health care would be the kind of the use case that we take this mainstream," Jamie Smith, the senior director of business development at Evernym, a company focused on using the blockchain as a basis for verifying identities, told Protocol. </p><p>Smith said Evernym had been discussing its concepts with automakers, retailers, telcos, governments, loyalty companies and banks prior to the pandemic. One of those companies was IAG, the airline group that owns British Airways, which had been interested in the idea of contactless travel based on a single identity credential that follows you from the airport check-in to your gate. With the pandemic, that morphed into thinking about ways to verify that passengers have had negative COVID tests, and eventually, that they've received a vaccine. "From our perspective, it was a really easy lift to see," Smith said. "We're doing contactless travel, and we just added verifiable credentials for test results."</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="2">
</div>
</div></p><p>It's a similar genesis for IBM's Digital Health Pass initiative, which leader Eric Piscini said started about two years ago as a way to store people's entire health records in a safe, accessible platform. It also relies on the blockchain for its immutable record of proof, and both Evernym and IBM are part of an open-standards group called the Good Health Pass Collaborative, which aims to bring private credentialed vaccine records to business and people around the world. Companies are working on their own implementations of the standards, but Evernym's Smith said the data is meant to be portable from one passport to another. </p><p>Most of the companies working on passports say their systems are private by design, especially given that they're mainly working off the same open standards. In most cases, the health information only ever remains on a user's phone, but where it asks to verify that the user's information meets a system's standards — such as whether this person has had two COVID vaccines and should be allowed into an office — that information is recorded on a blockchain. "You can, using blockchain technologies, verify that someone has been tested recently, without having access to the underlying data," Piscini said. "I don't know any other technology where you can do that."</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="3">
</div>
</div></p><p>Similarly, the nonprofit Commons Project's CommonPass, backed by the likes of Oracle, Microsoft and Salesforce, started out as a project to bring an analog to Apple Health for Android. JP Pollak, a senior researcher at Cornell and founder of the Commons Project, first launched CommonHealth to bring the sort of data and insights that Apple Health offers to iPhone owners to Android users. Last summer, the group started building an app that could take health data and privately share it with others — in that case, it was to help truckers stuck at the borders in <a href="https://www.newtimes.co.rw/opinions/digital-technology-re-opening-africa" rel="noopener noreferrer" target="_blank">East African countries</a> who couldn't easily prove they'd taken COVID tests. This morphed into vaccine credentialing, with the group now working to pull together the various data streams needed to get a project like this off the ground. </p><p>"Health care institutions, EMR vendors, retail pharmacies, state vaccine registries, all issuing people a digital verifiable credential of their vaccination record that they could then use in the app of their choice, to be able to get access to various kinds of services," Pollak said. CommonPass is also working with the Mayo Clinic, as well as Epic Systems and Cerner, two of the largest EMR vendors. </p><h3>Something for everyone </h3><p>With so many competing efforts to become the world's digital vaccine passport, it might seem that the country is heading for some sort of VHS versus Betamax format war for proving everyone has had COVID vaccines. But given that so many of the efforts are using the same standards, and in many cases, looking to embed their tech in someone else's app rather than their own, the race might be less about the best tech winning, and more about various approaches working in different situations. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="4">
</div>
</div></p><p>"The intent is not to be the only company; we don't want to be the proprietary platform that everybody has to use because they have no choice," IBM's Piscini said. "That's not who we are right now: That's the IBM from 30 years ago, not the IBM of today."</p><p>For IBM, though, the selling point is that the company already works with so many other massive companies. Why look elsewhere for a vaccine passport solution if your airline booking system is already powered by IBM? "We believe our network is going to be more valuable than any other because of our scale and our ability to integrate the platform with CRM systems, building systems or stadium systems — we can do that every day," Piscini said.</p><p class="shortcode-media shortcode-media-rebelmouse-image">
<img type="lazy-image" data-runner-src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yNTY2NTc3NS9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTYyMTM1MjYyM30._ykxxCyx3_wDbZrYgCcmK0QT2Ue1tZFdP5pf60kOmPU/img.jpg?width=980" id="c81c9" class="rm-shortcode" data-rm-shortcode-id="3967636652192acfdaad341861263bc8" data-rm-shortcode-name="rebelmouse-image">
<small class="image-media media-caption" placeholder="Add Photo Caption...">IATA's digital passport app.</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Photo: IATA</small></p><p>For other companies, it's about securing new partnerships with major players in the hopes of finding that scale. Evernym, for example, is working with International Air Transport Association, the airline industry's trade association, on an air travel-specific app called Travel Pass. IATA is working with airlines and local governments to ensure it has the latest requirements to feed the app's rules engine. "It will say, 'Hey, you're flying JFK to Heathrow, you need a PCR test 48 hours in advance before you can land,'" Evernym's Smith said. "And of course, those policy changes are changing every day." Qatar, Emirates and Etihad Airways are all <a href="https://simpleflying.com/qatar-iata-travel-pass-launch/" rel="noopener noreferrer" target="_blank">expected</a> to start trialing the app in the next few weeks.<br></p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="5">
</div>
</div></p><p>In other instances, the technology will live inside other companies' existing apps; why make someone download yet another app and add another hurdle to compliance? Instead, the experience will be rather like adding a loyalty account or TSA PreCheck number when booking a flight. Airlines and other venues restricting access will require uploading negative test results or vaccine records using one of these services. "You're going to be using the United or the Delta app, and they'll be using our solution or somebody else's, but you will do it via their app," IATA's Travel Pass lead, Alan Murray Hayden, told Protocol.</p><p>The World Health Organization is also working on its own offering, and recently convened the <a href="https://www.who.int/groups/smart-vaccination-certificate-working-group" rel="noopener noreferrer" target="_blank">Smart Vaccination Certificate Working Group</a>. It's built upon the WHO's nearly century-old notion of the "yellow card" vaccination record, which first was used to document that travelers had been inoculated against diseases such as cholera and yellow fever. Evernym Chief Trust Officer Drummond Reed is part of the working group; he said there should be more to share in the coming months. </p><h3>What could go wrong?</h3><p>It's entirely possible that as more people start to get vaccinated, vaccine passports start to become the norm. You walk to work — still masked, of course — scan a QR code reader in the lobby, and are let in. You go out for lunch, and your loyalty card app has a discount for in-store shoppers verifying they're vaccinated. Your concert ticket is also tied to health pass information that you shared earlier in the day with Ticketmaster. But there are more than a few hurdles ahead of the companies rushing to turn these concepts into realities. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="6">
</div>
</div></p><p>First off, there's the … reality … of the real world that any digital system has to contend with. For anyone without access to the internet, digital vaccine credentials will prove difficult to acquire, though all the companies Protocol spoke with said they would offer a paper-based QR code for people who don't have smartphones. But there's also the issue of having to corral so many different stakeholders into one system, especially when some health care providers are still reliant on antiquated database systems or <a href="https://www.protocol.com/manuals/health-care-revolution/electronic-health-records-after-coronavirus" target="_self">even paper records</a>. "The amount of inefficiency in the system is tremendous," IBM's Piscini said. </p><p>But in the U.S. at least, all vaccinators are required to report COVID-19 vaccines to their state. Piscini said that even for people who just received a paper copy of their vaccine records, systems like IBM's can likely link up to the state's immunization registry and allow people to import records to a vaccine passport.</p><p class="shortcode-media shortcode-media-rebelmouse-image">
<img type="lazy-image" data-runner-src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yNTY2NTc4My9vcmlnaW4ucG5nIiwiZXhwaXJlc19hdCI6MTYzNzg3MTM2M30.RZtqR7F_FuXK1S24V6jVaqUZ0xOSG-gCwj00xU3fxcM/img.png?width=980" id="b0bd3" class="rm-shortcode" data-rm-shortcode-id="11d8002d92c0cd6ef39b12fc7b8dccf8" data-rm-shortcode-name="rebelmouse-image">
<small class="image-media media-caption" placeholder="Add Photo Caption...">How CommonPass's app shows your records. </small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Image: CommonPass</small></p><p>And states are willing to help out, Pollak said, adding that CommonPass has started working with Hawaii to roll out its offering for would-be tourists. "We're seeing a lot of state governments stepping up and doing a really good job with this," Pollak said. "It would be surprising if there wasn't a coordinated federal effort very soon." That being said, while <a href="https://www.cbc.ca/news/canada/north/iceland-covid-passports-canada-1.5904828" rel="noopener noreferrer" target="_blank">many countries around</a> the world are committing to working on vaccine passports, getting a straight answer out of the U.S. government on what it's doing has proven difficult. The State Department, which maintains America's traditional, analogue passports, referred me to Homeland Security, which referred me to the White House. The acting director and chief of staff of the White House's Office of Science and Technology Policy, Kei Koizumi, told Protocol that "OSTP can't discuss projects we are working on before they are publicly announced."</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="7">
</div>
</div></p><p>But even with systems in place at a federal level, there's still a fair amount of education that needs to happen before people will trust systems like these. "There's a substantial gap in understanding and knowledge of how these systems work, and people's views, in terms of who should get access to which data," Pollak said. </p><p>"We assume there's a Facebook Borg in the sky, monitoring every interaction," Smith said. "The emergence of verifiable credentials breaks down that mental model, where actually it becomes more like decentralized bits of paper that I can carry around, and no one's to know that I've been sharing this information."</p><p>"Our belief is that if you do the right thing, from a platform point of view, protecting your privacy, and giving you control and access to the platform to everybody who wants to use it," Piscini said. "I think those are very basic things that allow the core of the platform that we build to generate adoption by the individuals."</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="8">
</div>
</div></p><p>Even with a system that works, there may still be holdouts to this potential new normal. "Some people are saying, 'I will never get vaccinated,'" Piscini said, "and I don't know if the airlines are going to say, 'Well, maybe you will never fly again.'"</p>
Keep Reading
Show less
Mike Murphy ( @mcwm) is the director of special projects at Protocol, focusing on the industries being rapidly upended by technology and the companies disrupting incumbents. Previously, Mike was the technology editor at Quartz, where he frequently wrote on robotics, artificial intelligence, and consumer electronics.
Google wants to connect everything you own to the internet
Surveilling older adults, connected helmets, wearables talking to doctors and other patents from Big Tech.
Make all the things smart!
Image: Google/USPTO
February 7, 2021
Mike Murphy ( @mcwm) is the director of special projects at Protocol, focusing on the industries being rapidly upended by technology and the companies disrupting incumbents. Previously, Mike was the technology editor at Quartz, where he frequently wrote on robotics, artificial intelligence, and consumer electronics.
February 7, 2021
Hello and welcome back to the world of zany patents from Big Tech! While 2020 is still dragging on (I know it's 2021, but you can't tell me 2020 is over until I can go anywhere other than the grocery store), at least there are still great new patents to uncover. And there's some fascinating ones this week, including Facebook wanting to make clothes like real in games, Microsoft trying to make sports more inclusive and Google wanting to make it easier to spy on your parents. If that's something you want to do.
And remember: The big tech companies file all kinds of crazy patents for things, and though most never amount to anything, some end up defining the future.
<h3>Alphabet</h3><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10909832&IDKey=E2C372F869B5%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D12%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dgoogle.ASNM.%2526OS%3DAN%2Fgoogle%2526RS%3DAN%2Fgoogle" rel="noopener noreferrer" target="_blank"><u><strong>Surveilling older adults</strong></u></a></p><p>People who have aging parents might find themselves checking in frequently to make sure Mom and Dad are OK, or even buying gadgets or products that make it a little easier to be self-sufficient. Google's solution, according to this patent, is a way to keep tabs on them remotely. Using smart sensors placed around the house, a system like Google Home could be set up to alert a third party about what's happening in the house. For example, the system can send an alert if it notices that nobody is moving around at specific times, and you can then decide whether to call or text to check in. Just be sure to ask your parents' permission first before you turn their home into a personal panopticon. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="1">
</div>
</div></p><p><img src="https://lh3.googleusercontent.com/aqPPk6Zx9eptCvcoH0C6gk9ttWQhaCtpeE8pxZjwGeI54BMZD60ZX3tMkzoTmRS-EOc3adg_0hEeJvy-guXvom7KGhlpLwEbPYmeEX-qZliYUB-9NJD8_XoFwbimneKW_yfHCK3s"></p><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10908732&IDKey=C0EE25D3B384%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D29%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dgoogle.ASNM.%2526OS%3DAN%2Fgoogle%2526RS%3DAN%2Fgoogle" target="_blank"><u><strong>Making analog products digital</strong></u></a></p><p>A few years ago, Google introduced Jacquard, its project for interweaving electronic sensors into fabrics. It's been used to add phone controls to denim jackets, bags and even shoes. It's a neat idea, but it requires you to buy new products that you might not actually want. With this patent, Google envisions bringing that same concept to any product you already own and making it smart. That could be things like touch sensors or tracking movement — perhaps you could just slap one of these on your parents instead of putting sensors all over their house. </p><p><img src="https://lh6.googleusercontent.com/bPwslTHzq2PFvILbefC4P8rID9ot4DROmm2HpREy8a2hT8N4nqoaNG7hsRUon0EUvTMIkEZx_GifA72qfM1vmVXE9iGIgqh0x-cIcz9QyoElPVewsZs-pEblxhUivDKSQwMLUR4S"></p><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10905328&IDKey=542E633FED99%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D6%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dverily.ASNM.%2526OS%3DAN%2Fverily%2526RS%3DAN%2Fverily" target="_blank"><u><strong>Keeping your doctor in the loop</strong></u></a></p><p>Alphabet's health research arm, Verily, is thinking about a future — which we <a href="https://www.protocol.com/manuals/health-care-revolution/future-of-health-care-wearables" target="_self"><u>might currently be living through</u></a> — where people don't need to get to the doctor to be diagnosed. This patent envisions a wearable that can constantly track your heart (it's unclear how much of a drain this would be on a small wearable battery), and identify any potential issues by consulting databases online, like if your data suggests that you might be having an arrhythmia. While there's a few wearables on the market that can do something like this right now, this patent imagines automatically sharing that data with your doctor, presumably so they could review the data, or potentially algorithmically warn you and your doctor that an emergency situation is underway. Hopefully it doesn't call your doctor <a href="https://twitter.com/mcwm/status/1170321867342843911" target="_blank"><u>if you suck at golf</u></a>, though. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="2">
</div>
</div></p><p><img src="https://lh5.googleusercontent.com/3avW8eqXPzgADxX3aAz9mt2_hYL9X0arzL_hrZD_E1U4WGceRmfAFtmOGRey5plQfwTeXvvk3RHdyzisWEDKdhuIZ1zVRrLCevaqO2XYPOvZ5CbJ-P-iezh6KzhLgGnttY98eXmY"></p><h3>Amazon</h3><p><a href="http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-adv.htm&r=64&f=G&l=50&d=PTXT&s1=amazon.ASNM.&p=2&OS=AN/amazon&RS=AN/amazon" target="_blank"><u><strong>Autonomous avoiding</strong></u></a></p><p>This one is conceptually quite straightforward, but important nonetheless when you're thinking about a phalanx of delivery drones flying around on their own. The patent outlines a laser range-finding system mounted on drone rotors that can help the drones "see" what's around them so they could shift their routes to avoid it. But for many in the drone industry, it's not really the tech that's holding back autonomous deliveries — <a href="https://www.protocol.com/alphabet-wing-drone-delivery-coronavirus" target="_self"><u>it's humans</u></a>. </p><p><img src="https://lh5.googleusercontent.com/BgpsJjJm62FynXbwVvwCY8gnA45ypo1HTs_SxBcZNfB1BuB0L824xC6ygkphev8sJPT55WEX-og5fNIzx3hvudtULw5pmx2HbaG_2S3Wmsifvq3TPtFVkZu074w4Fx10AuXeYnAX"></p><h3>Apple</h3><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10909389&IDKey=A422DE8D3462%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D49%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3D%252522apple%252Binc%252522.ASNM.%2526OS%3DAN%2F%252522apple%252Binc%252522%2526RS%3DAN%2F%252522apple%252Binc%252522" target="_blank"><u><strong>Detecting traffic wardens</strong></u></a></p><p>Rather like with autonomous delivery drones, it's good to know that Apple is thinking about what obstacles its autonomous vehicles might encounter. In this patent, it's specifically thinking about what to do when a car sees something that appears to be someone guiding traffic, and how to react to various hand signals they might make. This makes me think about a future where I could just carry a stop sign around with me and become the king of robot cars, directing them to follow my every whim. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="3">
</div>
</div></p><p><img src="https://lh4.googleusercontent.com/F6JQSxHys3DyDSpjetpIH9o_dffTSLDiU8OT5QBVw8-0Z41DPwI7d42RJAsJsbgoPG3f-iBMzo3vQiCCUWKxNlRPa1Vohgg2N_uLz51F_W0s9wA5Fm55k7DvbUax6hwYos5JlBIl"></p><h3>Facebook</h3><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10909744&IDKey=EF191432D67E%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D15%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dfacebook.ASNM.%2526OS%3DAN%2Ffacebook%2526RS%3DAN%2Ffacebook" target="_blank"><u><strong>Simulating clothing</strong></u></a></p><p>If you've ever played a video game where someone is wearing clothes (which is … most of them??), you've probably noticed that they don't exactly fall like the ones you wear IRL. I think my favorite example is uniforms in sports games; the systems usually recognize now that cloth stretches as people move, but then instead of just stretching the fabric, they'll stretch out the letters in players' names, making it look like the jerseys are made of elastic. Facebook's patent outlines a system that uses a machine learning-based "cloth simulator" to more realistically mimic how physics affects the wrinkles in simulated clothes. With Facebook's deep push into VR, this could be one of the things that helps the platform feel less like an awkward immersive video game and more like real life, represented in a headset. </p><p><img src="https://lh6.googleusercontent.com/hAYzpzP66pKPcM_kiwQSij5lS8BQNYz7uW0DU6jajuUZQU3lbxqzaZxmtsDrRaXBXRnua8ff8nanf1i0MMn_5AVlFuPRiQelhfpcNr2r_PbbT2qVV6lwcBukYMyv_c_UuoiM5-oF"></p><h3>Microsoft</h3><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10909321&IDKey=1CE7985A9F2E%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-adv.htm%2526r%3D52%2526f%3DG%2526l%3D50%2526d%3DPTXT%2526s1%3Dmicrosoft.ASNM.%2526p%3D2%2526OS%3DAN%2Fmicrosoft%2526RS%3DAN%2Fmicrosoft" target="_blank"><u><strong>An automatic travel diary</strong></u></a></p><p>When I was growing up, my mom used to make me write a diary anytime we went on vacation. It was a noble endeavor, but amazingly, my child brain was more interested in actually being on vacation than writing about it later. Regardless of what that might have meant from my chosen career, my adult brain is still a fan of this idea. The patent suggests a system that can auto-generate a travel diary based on your calls, texts, photos, location and other data from your phone. You could then share your digital diary with anyone you might want to make jealous — though you should probably consider whether giving over that much data to a system like this is worth the hate-likes. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="4">
</div>
</div></p><p><img src="https://lh4.googleusercontent.com/tV2JViV9zkMwQcQMg5nGU6-f9ijXqfIz79L47LV-utpG7-DY3Ll9-vovsj3Kp1piNzrFWq5vpka9NWGwbDoALamukQfBXOOZInqoCD5RWIN9wAHcmPmFhWDdOn-upm8_AYbgbo4B"></p><p><a href="http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=50&f=G&l=50&co1=AND&d=PTXT&s1=microsoft.ASNM.&OS=AN/microsoft&RS=AN/microsoft" target="_blank"><u><strong>Bringing sports to visually-impaired people</strong></u></a><br></p><p>If this could work, this could be a really neat way to make sports somewhat more inclusive. This patent envisions using sensors to help visually impaired people play sports. The example it gives includes something that looks a lot like an Xbox Kinect sensor built into a batting helmet. In the example, the helmet could provide a signal to the wearer that a pitch is incoming and it's time to swing. Alerts could be vibrations, sounds or other sensory flags. And although it might look odd to wear a batting helmet outside of the baseball diamond, the patent also envisions a system for other aspects of daily life, such as alerting the wearer when it's safe to cross the road. </p><p><img src="https://lh3.googleusercontent.com/mSxnCEL4X0Dm0lMpQ44R8ywUtfIYKOH5TA2rIOjAQa4rHmVDmenCuCTC6JuvEkxMrAFOPAo4ZWqqxtTb0HILAC_ZV3Y9dfbL8XIjNGjwRgibcmZWaOZ1P79j3obf2AgrRQNvoa4o"></p><p><br><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10909639&IDKey=8EBE02881232%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D42%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dmicrosoft.ASNM.%2526OS%3DAN%2Fmicrosoft%2526RS%3DAN%2Fmicrosoft" target="_blank"><u><strong>Icebreakers on social media</strong></u></a><br></p><p>If you've had to do any team-building exercises over Zoom during this pandemic, you've probably come across a few sessions of icebreaker questions. Maybe you've had to share what you'd take from your house in a fire, or what brands you unquestionably love. It's a sure-fire way to get people chatting. In this patent, Microsoft is envisioning bringing that energy into the rest of your life, whether on conversations you're having on social media, or even phone calls you're receiving. Pertinent information about friends, colleagues or new connections could be displayed next to their names on social media or when they're calling you, offering something to talk about other than work or the weather, like which marathons they've run or which '90s rock band they're still seeing live. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="5">
</div>
</div></p><p><img src="https://lh3.googleusercontent.com/gwkWFM3icGcOxAU6vhUYW-4Ihx5hVa2_6PwS6UrTf20Z2dZVKGk7XApUq5zO6trRDDsn1X37myIE2R-9-gYIzvTFbnr_he_lJTObrsqYcuxOB5ZChGdQkF1dZKJ0UrUiTc-O_Ul7"></p>
Keep Reading
Show less
Mike Murphy ( @mcwm) is the director of special projects at Protocol, focusing on the industries being rapidly upended by technology and the companies disrupting incumbents. Previously, Mike was the technology editor at Quartz, where he frequently wrote on robotics, artificial intelligence, and consumer electronics.
Latest Stories
See more
Most Popular
Bulletins
Get Source Code in your inbox
David Pierce's daily analysis of the tech news that matters.