Source Code: Your daily look at what matters in tech.
To give you the best possible experience, this site uses cookies. If you continue browsing. you accept our use of cookies. You can review our privacy policy to find out more about the cookies we use.
source-codesource codeauthorDavid PierceNoneWant your finger on the pulse of everything that's happening in tech? Sign up to get David Pierce's daily newsletter.64fd3cbe9f
Subscribe to
Want to better understand the $150 billion gaming industry? Get Shakeel Hashim's newsletter every Tuesday.
Are you keeping up with the latest cloud developments? Get Tom Krazit and Joe Williams' newsletter every Monday and Thursday.
David Wertime and our data-obsessed China team analyze China tech for you. Every Wednesday, with alerts on key stories and research.
Want your finger on the pulse of everything that's happening in tech? Sign up to get David Pierce's daily newsletter.
Do you know what's going on in the venture capital and startup world? Get the Pipeline newsletter every Saturday.
Do you know what's coming next up in the world of tech and entertainment? Get Janko Roettgers' newsletter every Thursday.
Hear from Protocol's experts on the biggest questions in tech. Get Braintrust in your inbox every Thursday.
Get access to the Protocol | Fintech newsletter, research, news alerts and events.
November 10, 2020
"We love the Mac," Tim Cook said at the beginning of Tuesday's Apple launch event, and I swear I could hear every developer in Silicon Valley yell, "Yeah, OK, whatever, Tim, how about that keyboard!"
Apple clearly thinks the future for most people looks more like an iPad than a laptop or desktop. But after Tuesday's event, it's at least obvious it still cares about the Mac.
- It's launching three new Macs, all running the company's homemade M1 chip: a new MacBook Air, a new MacBook Pro and a new Mac Mini. All three are meant to be faster and more efficient than their Intel-powered brethren. And on the laptops? It's all about battery life.
- Apple framed the new lineup as more than just "the Macs you know, now with Apple Silicon." It seems to understand that most people's PCs are the hub of their setups: maybe not the device they use most often, but the one that has all the storage and all the apps.
- That means making the Mac work more like — and better with — your other devices becomes all the more important.
Apple's pushing hard on universal apps and the Rosetta 2 tech that makes mobile apps work on Macs even without extra work. This idea has a long, decorated history of not working very well (just ask the Chrome OS or Windows RT teams), but it's also true that nobody wrangles developers like Apple does.
- It does really want you to care about the M1 chip, though. It's only five nanometers! 16 billion transistors! It was classic all-our-competitors-suck posturing from Apple. And you can tell, just from the sheer amount of time it spent on teraflops and per-watt performance, that Apple sees the Mac as mostly a power-user device.
- And in case you're waiting to dive in until you're sure Apple's serious about the chip, it looks like you can be sure. They're already rolling the M1 into three devices: the Pro, the Mini and the Air. This switch is going to happen, and it sounds like it's going to happen quickly.
A version of this story will run in Wednesday's Source Code newsletter. Sign up here.
From Your Site Articles
David Pierce
David Pierce ( @pierce) is Protocol's editor at large. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.
App store laws, Microsoft AR and Square buys Tidal
Welcome to this weekend's Source Code podcast.
Cole Burston/Bloomberg
March 7, 2021
David Pierce ( @pierce) is Protocol's editor at large. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.
March 7, 2021
This week on the Source Code podcast: First, an update on Google's user-tracking change. Then, Ben Pimentel joins the show to discuss Square buying Tidal, and what it means for the fintech and music worlds. Later, Emily Birnbaum explains the bill moving through the Arizona legislature that has Google and Apple worried about the future of app stores. And finally, Janko Roettgers discusses Microsoft Mesh, the state of AR and VR headsets, and when we're all going to be doing meetings as holograms.
For more on the topics in this episode:
<ul class="ee-ul"><li><a href="https://www.protocol.com/square-tidal-jack-dorsey-banking" target="_self">Jack Dorsey is so money: What Tidal and banking do for Square</a></li><li><a href="https://www.protocol.com/policy/apple-google-lobbyists-arizona-bill" target="_self">Apple and Google lobbyists are swarming Arizona over a bill that would reform the app store</a></li><li><a href="https://www.protocol.com/bulletins/virginia-second-state-privacy-2650864098" target="_self">Virginia becomes second state with comprehensive privacy law</a></li><li><a href="https://www.protocol.com/microsoft-mesh-ar-vr-platform" target="_self">Microsoft's master plan for consumer AR: Start with the plumbing</a></li><li><a href="https://www.protocol.com/newsletters/next-up/microsoft-mesh-facebook-ar-glasses?rebelltitem=1#rebelltitem1" target="_self">How Microsoft could beat Facebook in AR</a></li></ul><p><strong>Subscribe to the show: <a href="https://podcasts.apple.com/us/podcast/protocols-source-code/id1497440658" rel="noopener noreferrer" target="_blank">Apple Podcasts</a> | <a href="https://open.spotify.com/show/1mc6ODYq0nZ8hrVDuvQfeL?si=HDPznyjDSEqv5EvMZxhKxQ" rel="noopener noreferrer" target="_blank">Spotify</a> | <a href="https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkcy5zaW1wbGVjYXN0LmNvbS95OVNfTjJfaw==" rel="noopener noreferrer" target="_blank">Google Podcasts</a> | <a href="https://pca.st/7ktyvlll" rel="noopener noreferrer" target="_blank">Pocket Casts</a> | </strong><a href="https://feeds.simplecast.com/y9S_N2_k" rel="noopener noreferrer" target="_blank"><strong>RSS</strong></a></p>
Keep Reading
Show less
David Pierce ( @pierce) is Protocol's editor at large. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.
Sponsored Content
The future of computing at the edge: an interview with Intel’s Tom Lantzsch
An interview with Tom Lantzsch, SVP and GM, Internet of Things Group at Intel
February 28, 2021
Saul Hudson has a deep knowledge of creating brand voice identity, especially in understanding and targeting messages in cutting-edge technologies. He enjoys commissioning, editing, writing, and business development, in helping companies to build passionate audiences and accelerate their growth. Hudson has reported from more than 30 countries, from war zones to boardrooms to presidential palaces. He has led multinational, multi-lingual teams and managed operations for hundreds of journalists. Hudson is a Managing Partner at Angle42, a strategic communications consultancy.
February 27, 2021
An interview with Tom Lantzsch
Senior Vice President and General Manager of the Internet of Things Group (IoT) at Intel Corporation
Edge computing had been on the rise in the last 18 months – and accelerated amid the need for new applications to solve challenges created by the Covid-19 pandemic. Tom Lantzsch, Senior Vice President and General Manager of the Internet of Things Group (IoT) at Intel Corp., thinks there are more innovations to come – and wants technology leaders to think equally about data and the algorithms as critical differentiators.
In his role at Intel, Lantzsch leads the worldwide group of solutions architects across IoT market segments, including retail, banking, hospitality, education, industrial, transportation, smart cities and healthcare. And he's seen first-hand how artificial intelligence run at the edge can have a big impact on customers' success.
Protocol sat down with Lantzsch to talk about the challenges faced by companies seeking to move from the cloud to the edge; some of the surprising ways that Intel has found to help customers and the next big breakthrough in this space.
What are the biggest trends you are seeing with edge computing and IoT?
A few years ago, there was a notion that the edge was going to be a simplistic model, where we were going to have everything connected up into the cloud and all the compute was going to happen in the cloud. At Intel, we had a bit of a contrarian view. We thought much of the interesting compute was going to happen closer to where data was created. And we believed, at that time, that camera technology was going to be the driving force – that just the sheer amount of content that was created would be overwhelming to ship to the cloud – so we'd have to do compute at the edge. A few years later – that hypothesis is in action and we're seeing edge compute happen in a big way.
<p>The last 18 months have been a wild time to be in technology. We've seen edge compute come to life to help businesses adapt during the pandemic. At the same time, we are also seeing how 5G is going to drive up interest, especially from a networking perspective, rather than a use-case perspective. We also see lot of people that are focused on their data, but the <em>algorithms</em> that companies train with the data are going to be their critical assets. It doesn't matter what company or what industry; <em>this</em> will really become the differentiator for many companies.</p><p>And particularly amid the backdrop of the pandemic, we've seen how companies are using technology to either bring workers back in safely or <a href="https://www.intel.com/content/www/us/en/corporate-responsibility/covid-19-response-sensormatic-article.html" target="_blank">serve their customers in new ways</a>, <a href="https://www.intel.com/content/www/us/en/customer-spotlight/stories/brentwood-academy-customer-spotlight.html" rel="noopener noreferrer" target="_blank">educate children in new ways</a> -- all things that have accelerated the digital transformation that had been underway. I recently read a <a href="https://www.mckinsey.com/business-functions/strategy-and-corporate-finance/our-insights/how-covid-19-has-pushed-companies-over-the-technology-tipping-point-and-transformed-business-forever" rel="noopener noreferrer" target="_blank">McKinsey survey</a> that reported on the "speedup in creating digital or digitally enhanced offerings. Across regions, the results suggest a seven-year increase, on average, in the rate at which companies are developing these products and services."</p><p>And based on what we're seeing at Intel, those are lifesaving and industry saving investments happening today – completely re-designing the way that <a href="https://www.intel.com/content/www/us/en/corporate-responsibility/covid-19-response-mic-article.html" rel="noopener noreferrer" target="_blank">patients are treated</a>, and businesses operate.</p><h4>What are you particularly expecting to see this year?</h4><p>What I find most interesting is the work that combines IoT with networking capabilities – and I think this is going to be a year of expansive exploration and working with our customers to put these two things together to solve real business challenges.</p><p>When we first started the integration of networking technology and operational technology capabilities and layered that across the industry verticals, we could count the amount of interested customers and opportunities on one hand. Last year, it was five times that many and this year we see that number increasing significantly already. So, we're excited to see the industry continue to build excitement to scale those types of deployments.</p><h4>What role does AI play at the edge and in what way is Intel involved?</h4><p>An AI use case recently grabbed my attention: employees in a restaurant being screened by a device that checks temperature while the employees are washing their hands – and provides a determination on whether they'd done it adequately before they report to work. I have seen other applications using similar technology in the <a href="https://marketplace.intel.com/s/offering/a5b3b000000TiMSAA0/using-ai-to-make-construction-site-safer?language=en_US" rel="noopener noreferrer" target="_blank">construction industry</a>, where an AI algorithm scans to see if employees have their helmet, goggles, vest and other safety equipment on properly to determine if they are ready to work. And the best part is – that the employer can see aggregate data on these interactions to determine if more training on handwashing or helmet wearing is needed.</p><p>At Intel, in addition to providing the fundamental base technology to enable these applications, we work with a lot of third-party developers to create these applications. And we help the developers scale them across multiple industries with our salesforce. So, we may not make the scan technology that determines if you have the right gear on, but we orchestrate that coordination across our ecosystem with all of our partners to effectively put it into a <a href="https://marketplace.intel.com/s/?language=en_US" rel="noopener noreferrer" target="_blank">catalog</a> so that if customers are interested in that sort of application, we can provide them with different parties to make that happen.</p><h4>Is there a problem with fragmentation in the market and how can that be solved?</h4><p>It's very fragmented. I gave just two examples of totally different workers coming to work in different industries and I can give you five more that are different again. Although the base technology that Intel creates to enable this type of innovation is very horizontal in nature, the reality is that bringing those to life must be very "vertically-centered" and very "use-case centered" – and must take into account, geography. The two employee use cases I cited look very different if you are talking about employees in North America, India or Germany. So, all in all, this is a holistic ecosystem challenge – and an ecosystem solution.</p><p>At Intel, we're in a unique situation to orchestrate these solutions. </p><p><cite class="pull-quote">People tend to think of Intel as providing the technical footprint that enables edge computing – but we also have the developer reach – and we can use our ecosystem and scale to help our end customers get access to the best solutions.</cite></p><h4>What sort of challenges do customers face when they're attempting to adopt edge computing?</h4><p>There are two common challenges. One is the technical question of 'Who can I work with?' A customer may have a chip focus but actually, it's a more complex question than a chip. We like that complexity, because we can be an adviser to them and <a href="https://marketplace.intel.com/s/partners-by-industry?language=en_US" rel="noopener noreferrer" target="_blank">bring to the table partners</a> that they can work with to solve that complexity leveraging our technical knowledge and ecosystem network. </p><p>The second thing that companies struggle with is the challenge of how to fund getting into this space – even if the business case warrants the investment. The world has changed. Companies don't want to write a big capital check for these types of investments – they want a pay-as-you-go model, like you see with the cloud. We've been working with customers to find a way to make that happen – and I think that is going to be a bigger part of the conversation moving forward.</p><p>You can see it across almost every aspect of technology now. We rent compute more than we buy compute. Evidenced by the success of AWS, companies can rent compute from Amazon instead of building their own data center – and there are many benefits to that approach. In the old world, even for this video conference that we're having today we would have installed capital to do this. Now it's just a service. And I think that edge as a service is right around the corner.</p><h4>Do you have an example of that?</h4><p>A customer in Mexico wanted to deploy outdoor WiFi and add security features into it. So, it was an edge-based computing issue that was part connectivity. But there was actually way more to it than just installing it. We not only helped to solved the technological challenge creatively and coordinated the <a href="https://marketplace.intel.com/s/partners-by-industry?language=en_US" rel="noopener noreferrer" target="_blank">ecosystem of providers</a> to solve this, but we also found a way so that the customer could get into this market with a service-based model without needing to outlay a lot of capital.</p><p>Other semiconductor companies would have a difficult time partnering on both sides of that challenge, but Intel can do it because we have the scale.</p><h4>How do businesses identify which functions they do want to perform at the edge versus in the cloud?</h4><p>It really comes down to a question of what you're trying to do and how you do it at the lowest cost, highest quality and standard in computability.</p><p>If you have an application and it can perform what you need it to do in the cloud, you'll probably run it there. The cloud is a great thing - there's infinite compute and lots of choice in a well-understood developer environment.</p><p>But there are many things you can't or shouldn't do in the cloud for certain reasons. Take the camera example from earlier. Say you have eight high-density cameras, and you want an action on them immediately. You may not be able to afford the latency that comes with going up into the cloud. Or it may be a financial challenge – that its actually more expensive to send that data to the cloud over and over again, and it makes sense to invest in compute at the edge. There are nuances in the decision-making. It really comes down to what you want the application to do, how quickly and how much it should cost.</p><h4>How does Intel help developers to learn, to build and then test their solutions at the edge?</h4><p>To enable what we know to be interesting and challenging use cases at the edge, required us to change our focus on who these developers are and what they care about. We learned that they <em>really</em> don't care about what hardware they're running on. The modern developers are fairly well extracted from the hardware – they just assume the compute is going to be available for them to do their work.</p><p>To make sure we can deliver on that, we typically target developers by specific capability. The most advanced case that we've been studying on the edge recently is focused video and specifically, video inferencing and AI inferencing. We created a tool called <a href="https://software.intel.com/content/www/us/en/develop/tools/openvino-toolkit.html" rel="noopener noreferrer" target="_blank">OpenVINO</a>, which was developed in a way that developers didn't have to care about the hardware it runs on. It's a model optimization technology that enables them to easily scale out to different hardware platforms. That's proven to be an interesting value proposition to these developers.</p><p>Our goal with <a href="https://software.intel.com/content/www/us/en/develop/tools/openvino-toolkit.html" rel="noopener noreferrer" target="_blank">OpenVINO</a> is democratize AI activity and inference at the edge. We want to make it simple -- to put these tools in the hands of non-data scientists and make it work. As a part of that process, we're also creating an environment where they can develop anyplace, anytime, anywhere they want to be. We're so proud of our <a href="https://software.intel.com/content/www/us/en/develop/tools/openvino-toolkit.html" rel="noopener noreferrer" target="_blank">OpenVINO</a> community and are constantly working to grow the community and release new features and capabilities to edge developers.</p><h4>What's the possible next breakthrough that you see for Intel in edge computing and the IoT space?</h4><p>I'm looking forward to the big breakthrough when we show integrated 5G, Virtual Private Network and the edge workloads all in one unit. More to come.</p>
Keep Reading
Show less
Saul Hudson has a deep knowledge of creating brand voice identity, especially in understanding and targeting messages in cutting-edge technologies. He enjoys commissioning, editing, writing, and business development, in helping companies to build passionate audiences and accelerate their growth. Hudson has reported from more than 30 countries, from war zones to boardrooms to presidential palaces. He has led multinational, multi-lingual teams and managed operations for hundreds of journalists. Hudson is a Managing Partner at Angle42, a strategic communications consultancy.
Power
Google wants to help you get a life
Digital car windows, curved AR glasses, automatic presentations and other patents from Big Tech.
A new patent from Google offers a few suggestions.
Image: USPTO
February 28, 2021
Mike Murphy ( @mcwm) is the director of special projects at Protocol, focusing on the industries being rapidly upended by technology and the companies disrupting incumbents. Previously, Mike was the technology editor at Quartz, where he frequently wrote on robotics, artificial intelligence, and consumer electronics.
February 28, 2021
Another week has come to pass, meaning it's time again for Big Tech patents! You've hopefully been busy reading all the new Manual Series stories that have come out this week and are now looking forward to hearing what comes after what comes next. Google wants to get rid of your double-chin selfie videos and find things for you as you sit bored at home; Apple wants to bring translucent displays to car windows; and Microsoft is exploring how much you can stress out a virtual assistant.
And remember: The big tech companies file all kinds of crazy patents for things, and though most never amount to anything, some end up defining the future.
<h3>Alphabet</h3><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10929982&IDKey=D2992D61B62A%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D13%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dgoogle.ASNM.%2526OS%3DAN%2Fgoogle%2526RS%3DAN%2Fgoogle" rel="noopener noreferrer" target="_blank"><strong>Making selfies look better</strong></a></p><p>Perhaps even before our lives were dominated by video calls, you might've noticed when someone just couldn't figure out where to place their camera. Generally, anything below eye height is going to lead to some unflattering angles, but if you're also on a phone, holding your device up that long can get tiring. Google is apparently trying to solve this with AR: According to this patent, it's looking into using the depth sensors found on the front of many smartphones to re-create your face in video calls at a more flattering angle, to reduce what the pattern calls "the big nose effect." I'm here for this concept, but also Google's depiction of what it's trying to eliminate:</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="1">
</div>
</div></p><p><img src="https://lh5.googleusercontent.com/lYYEYZ52NjuL8M2BnrKVI80huN6UBNYEl1sFEScg5s5MdKrv8n2pBlI3tqXw3ooNJh8h2fWLTeTQaI4TrETMRu-E8ld49QGy3U783TOD8k8WMIR0lPZBAlCih9p3NU4U2sOEqtuI"></p><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10929885&IDKey=AFA7541891BF%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D16%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dgoogle.ASNM.%2526OS%3DAN%2Fgoogle%2526RS%3DAN%2Fgoogle" target="_blank"><strong>Jamming more ads into Maps</strong></a></p><p>Google Maps has become increasingly beset with ads in recent years, with promoted pins and locations on various instances of Maps. But this patent, which determines how Google goes about valuing ads in Google Maps — it, shockingly, has a lot to do with location — shows that the company might be looking at turning every part of the world into a digital version of Times Square, by displaying ads in-between the streets on a map. Hopefully it doesn't feel the need to run ads in <em>all</em> these potential slots at once, as that might make it rather difficult to navigate: </p><p><img src="https://lh6.googleusercontent.com/JcWTDCLxLAIEnhwl__JCNqeGm5ivedVoZVx_t83zGUntlZdU2H3CeQm9L3RC7QEZ_Cbb1n8B-bq_B-UJoATR2JiehxRwlA_O9GgO2BcEsph9C2cMPihvsdIWJlG9iJfvo4hTmLG9"></p><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10929486&IDKey=8946337F7961%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D23%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dgoogle.ASNM.%2526OS%3DAN%2Fgoogle%2526RS%3DAN%2Fgoogle" target="_blank"><strong>Outsourcing having a life to AI</strong></a></p><p>It's tough to do things, I know. Many days, even before the pandemic, I was content to just sit on the couch all day watching TV and ordering takeout. But Google is apparently looking into outsourcing to a virtual assistant the task of making sure you actually get your butt off the sofa. The patent outlines an assistant that could suggest things to do, as well as where and when to do them, based on the user's preferences. It could also suggest things to do that your friends or other users have enjoyed doing. Some of the suggestions aren't exactly things I'd consider a hobby, though: choosing "fight off a cold" as an activity is a really odd way to want to pass the time. <img src="https://lh4.googleusercontent.com/uHktu_DhtqRY9P68bJLJeoFceXUWTrtEeTN7xB6hiBFWxiCY5FDqrZW0zGkqlssZ481nmrNba9nGYXrsdfEk0eTsG64QXV37qaAfQ51BYGhs5DlwKuNJiA2WI5uGtQaLcOS_INsS"></p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="2">
</div>
</div></p><h3>Amazon</h3><p><a href="http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=27&f=G&l=50&co1=AND&d=PTXT&s1=amazon.ASNM.&OS=AN/amazon&RS=AN/amazon" target="_blank"><strong>Searching using loyalty programs</strong></a></p><p>When you search for things online, you're generally only shown the prices for things that everyone sees. But if you're a member of a loyalty program, you might often get discounts or other benefits that could make some products cheaper or more attractive. Amazon's patent outlines a search engine that can store which loyalty programs you're a part of, and show any deals associated with that membership that businesses might be running. This could be useful for finding deals at partners of loyalty programs that you might not be aware of, but if you're already loyal to one hotel or airline brand, you're probably going to search them first before doing a general search. </p><p><img src="https://lh3.googleusercontent.com/XSeV507IoB60vuP-AKADzUQH3OCfoDarf4Ahdgo0kNH-YxVe6qj-MRv9dfGECwElzPftQ3dJfMBeJq5fEEaqcAR6cyprVeBF99cienf2ipJGV35gR5LrTL8RVSOqAHqtqKrMX6Et"></p><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10929810&IDKey=0F7C251F2619%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D23%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Damazon.ASNM.%2526OS%3DAN%2Famazon%2526RS%3DAN%2Famazon" target="_blank"><strong>Indoor drones</strong></a></p><p>Amazon has been making waves for years about using autonomous drones for delivering orders, but to date, it hasn't gotten much traction. It seems, according to this patent, to be turning its attention at least partly to a less-regulated bit of airspace: indoors. The patent explains how autonomous drones, fitted with cameras and sensors, could be used to inspect inventory stored in the bins in the company's massive, high-ceilinged warehouses. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="3">
</div>
</div></p><h3>Apple</h3><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10928697&IDKey=B939F26801A6%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-adv.htm%2526r%3D51%2526f%3DG%2526l%3D50%2526d%3DPTXT%2526s1%3D%252522apple%252Binc%252522.ASNM.%2526p%3D2%2526OS%3DAN%2F%252522apple%252Binc%252522%2526RS%3DAN%2F%252522apple%252Binc%252522" target="_blank"><strong>Smart tinted windows</strong></a></p><p>This feels like a concept you'd see in sci-fi films set in a future where people have time to kill in the back of a self-driving car. Instead of staring at their phones, the sunroof and windows tint black, and news programs or views of scenic landscapes would replace whatever dystopian cityscape the car is driving through. It seems that Apple is looking into turning this into a reality, by creating see-through glass panes embedded with LEDs and other light sources that could change the color of the glass and allow information to be displayed on it. Pair that with the AR maps it was working on from <a href="https://www.protocol.com/alphabet-eat-balloons" target="_self">last week</a>, and you could have a whole new way of looking at driving on your hands. </p><h3>Facebook</h3><p><a href="http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=29&f=G&l=50&co1=AND&d=PTXT&s1=facebook.ASNM.&OS=AN/facebook&RS=AN/facebook" rel="noopener noreferrer" target="_blank"><strong>Curved-lens AR glasses</strong></a></p><p>This feels a little bit like the walking-around version to Apple's patent above. Most AR headsets use cameras to portray information on flat surfaces in front of your eyes. If you're like me and wear giant glasses that make you look like an owl, that might be fine, as your entire field of view is covered by lenses, but this patent explores adding AR to the periphery as well. The glasses in the patent have lenses that curve around the side of the frames so that they can overlay information on your peripheral view, which could make the experience of augmenting reality feel a little less jarring. That said, you would have to go out in public wearing something that looks like this: </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="4">
</div>
</div></p><p><img src="https://lh6.googleusercontent.com/YQudRSE9rpgmW6sFYiOU7-fK_tijuGQMxUhPKBq9cQWjmapgqPuV-K2FKAb-C_mlGqBmzOeFisYN3K2JLXqjzmvJzsHuEwfPo-_-CiIodnZg-alfFF1wsw74xVkb5nNaTx-pU71_"></p><h3>Microsoft</h3><p><a href="http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=36&f=G&l=50&co1=AND&d=PTXT&s1=microsoft.ASNM.&OS=AN/microsoft&RS=AN/microsoft" target="_blank"><strong>Automatic presentation controls</strong></a></p><p>If you've ever watched a presentation from a major tech company and wondered how they nailed the timing on slide changes so well … it's probably because they've rehearsed it a thousand times and have someone whose job it is just to press forward on the slide at the right time. But if you don't have that luxury at your disposal, you might find the ideas in this patent helpful. Microsoft is exploring presentation software that would be able to listen for cues in your speech to detect that you've gotten to the end of one slide, and move you automatically on to the next. It also suggests doing a training run, where the user runs through their presentation, manually clicking where they want to change slides, and the system would record that and do it automatically when they go to present. I'm not sure about having to have something listen to me at all times to get this to work, but it'd make presentations a lot less awkward than the "please can you click to the next slide, no, not the last slide, the next one" that often happens. </p><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10931607&IDKey=7B2CDAAF4E95%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D19%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dmicrosoft.ASNM.%2526OS%3DAN%2Fmicrosoft%2526RS%3DAN%2Fmicrosoft" rel="noopener noreferrer" target="_blank"><strong>Getting angry at virtual assistants to get results</strong></a></p><p>Stressing other people out when you're in charge is a very easy, albeit not very amenable, way to get stuff done. If you're having a conversation with someone and they stress to you, "I <em>need</em> you to get this back to me by end of day," and you know that they are ultimately the person who could end your employment, you're very likely going to get it back to them soon, unless you don't want to work there anymore. It's a lot harder to convey emotion and stress like that to a digital assistant, but this patent is exploring being able to understand human intonation and emotion in requests, such as a user stressing that they need to get a meeting scheduled with someone by the end of the week, which the AI would interpret as it being an urgent meeting when looking for time to schedule. Hopefully when the robot uprising comes, they'll not be too annoyed at us taking them for granted as digital PAs. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="5">
</div>
</div></p><p><img src="https://lh6.googleusercontent.com/CHYmBNr1k8asJ9p8zi43L-PaaZ5dYVTxgP5mblcY4OmjXw5YoLRZQxZCLBJPDurDGO1QQyCe4_A__MUCFgfubokFtskr7qHjgZOHlsv76dvmVtv7P6iWpys6pqmMrroiPNrIkPi0"></p>
From Your Site Articles
Keep Reading
Show less
Mike Murphy ( @mcwm) is the director of special projects at Protocol, focusing on the industries being rapidly upended by technology and the companies disrupting incumbents. Previously, Mike was the technology editor at Quartz, where he frequently wrote on robotics, artificial intelligence, and consumer electronics.
Transforming 2021
Blockchain, QR codes and your phone: the race to build vaccine passports
Digital verification systems could give people the freedom to work and travel. Here's how they could actually happen.
One day, you might not need to carry that physical passport around, either.
Photo: CommonPass
February 23, 2021
Mike Murphy ( @mcwm) is the director of special projects at Protocol, focusing on the industries being rapidly upended by technology and the companies disrupting incumbents. Previously, Mike was the technology editor at Quartz, where he frequently wrote on robotics, artificial intelligence, and consumer electronics.
February 23, 2021
There will come a time, hopefully in the near future, when you'll feel comfortable getting on a plane again. You might even stop at the lounge at the airport, head to the regional office when you land and maybe even see a concert that evening. This seemingly distant reality will depend upon vaccine rollouts continuing on schedule, an open-sourced digital verification system and, amazingly, the blockchain.
Several countries around the world have begun to prepare for what comes after vaccinations. Swaths of the population will be vaccinated before others, but that hasn't stopped industries decimated by the pandemic from pioneering ways to get some people back to work and play. One of the most promising efforts is the idea of a "vaccine passport," which would allow individuals to show proof that they've been vaccinated against COVID-19 in a way that could be verified by businesses to allow them to travel, work or relax in public without a great fear of spreading the virus.
<p><div class="ad-tag"><div class="ad-place-holder" data-pos="1">
</div>
</div></p><p>But building a system that everyone agrees with — and can access — is no small task. There are several companies working on competing projects to verify vaccinations. But beyond that, there are more than a few hurdles that could prevent vaccine passports from succeeding, from antiquated medical records systems to interoperability issues and privacy concerns. Here's how they could actually succeed. </p><h3>Competing projects, similar standards</h3><p>Pretty much since the first blockchain white paper, people have been looking for perfect examples of where a distributed, immutable ledger could be valuable. There's obviously the push to use it for currencies, and companies have tried to use it for things like tracking <a href="https://www.protocol.com/ibm-blockchain-supply-produce-coffee" target="_self">food production</a> and <a href="https://www.govtech.com/products/Blockchain-Voting-Debate-Heats-Up-After-Historic-Election.html" rel="noopener noreferrer" target="_blank">voting</a>, but there are few use cases that have truly taken off, at least so far. "We've been working on this since 2014; we never thought that health care would be the kind of the use case that we take this mainstream," Jamie Smith, the senior director of business development at Evernym, a company focused on using the blockchain as a basis for verifying identities, told Protocol. </p><p>Smith said Evernym had been discussing its concepts with automakers, retailers, telcos, governments, loyalty companies and banks prior to the pandemic. One of those companies was IAG, the airline group that owns British Airways, which had been interested in the idea of contactless travel based on a single identity credential that follows you from the airport check-in to your gate. With the pandemic, that morphed into thinking about ways to verify that passengers have had negative COVID tests, and eventually, that they've received a vaccine. "From our perspective, it was a really easy lift to see," Smith said. "We're doing contactless travel, and we just added verifiable credentials for test results."</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="2">
</div>
</div></p><p>It's a similar genesis for IBM's Digital Health Pass initiative, which leader Eric Piscini said started about two years ago as a way to store people's entire health records in a safe, accessible platform. It also relies on the blockchain for its immutable record of proof, and both Evernym and IBM are part of an open-standards group called the Good Health Pass Collaborative, which aims to bring private credentialed vaccine records to business and people around the world. Companies are working on their own implementations of the standards, but Evernym's Smith said the data is meant to be portable from one passport to another. </p><p>Most of the companies working on passports say their systems are private by design, especially given that they're mainly working off the same open standards. In most cases, the health information only ever remains on a user's phone, but where it asks to verify that the user's information meets a system's standards — such as whether this person has had two COVID vaccines and should be allowed into an office — that information is recorded on a blockchain. "You can, using blockchain technologies, verify that someone has been tested recently, without having access to the underlying data," Piscini said. "I don't know any other technology where you can do that."</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="3">
</div>
</div></p><p>Similarly, the nonprofit Commons Project's CommonPass, backed by the likes of Oracle, Microsoft and Salesforce, started out as a project to bring an analog to Apple Health for Android. JP Pollak, a senior researcher at Cornell and founder of the Commons Project, first launched CommonHealth to bring the sort of data and insights that Apple Health offers to iPhone owners to Android users. Last summer, the group started building an app that could take health data and privately share it with others — in that case, it was to help truckers stuck at the borders in <a href="https://www.newtimes.co.rw/opinions/digital-technology-re-opening-africa" rel="noopener noreferrer" target="_blank">East African countries</a> who couldn't easily prove they'd taken COVID tests. This morphed into vaccine credentialing, with the group now working to pull together the various data streams needed to get a project like this off the ground. </p><p>"Health care institutions, EMR vendors, retail pharmacies, state vaccine registries, all issuing people a digital verifiable credential of their vaccination record that they could then use in the app of their choice, to be able to get access to various kinds of services," Pollak said. CommonPass is also working with the Mayo Clinic, as well as Epic Systems and Cerner, two of the largest EMR vendors. </p><h3>Something for everyone </h3><p>With so many competing efforts to become the world's digital vaccine passport, it might seem that the country is heading for some sort of VHS versus Betamax format war for proving everyone has had COVID vaccines. But given that so many of the efforts are using the same standards, and in many cases, looking to embed their tech in someone else's app rather than their own, the race might be less about the best tech winning, and more about various approaches working in different situations. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="4">
</div>
</div></p><p>"The intent is not to be the only company; we don't want to be the proprietary platform that everybody has to use because they have no choice," IBM's Piscini said. "That's not who we are right now: That's the IBM from 30 years ago, not the IBM of today."</p><p>For IBM, though, the selling point is that the company already works with so many other massive companies. Why look elsewhere for a vaccine passport solution if your airline booking system is already powered by IBM? "We believe our network is going to be more valuable than any other because of our scale and our ability to integrate the platform with CRM systems, building systems or stadium systems — we can do that every day," Piscini said.</p><p class="shortcode-media shortcode-media-rebelmouse-image">
<img type="lazy-image" data-runner-src="https://www.protocol.com/media-library/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yNTY2NTc3NS9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTYyMTM1MjYyM30._ykxxCyx3_wDbZrYgCcmK0QT2Ue1tZFdP5pf60kOmPU/image.jpg?width=980" id="2c61a" class="rm-shortcode" data-rm-shortcode-id="3967636652192acfdaad341861263bc8" data-rm-shortcode-name="rebelmouse-image">
<small class="image-media media-caption" placeholder="Add Photo Caption...">IATA's digital passport app.</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Photo: IATA</small></p><p>For other companies, it's about securing new partnerships with major players in the hopes of finding that scale. Evernym, for example, is working with International Air Transport Association, the airline industry's trade association, on an air travel-specific app called Travel Pass. IATA is working with airlines and local governments to ensure it has the latest requirements to feed the app's rules engine. "It will say, 'Hey, you're flying JFK to Heathrow, you need a PCR test 48 hours in advance before you can land,'" Evernym's Smith said. "And of course, those policy changes are changing every day." Qatar, Emirates and Etihad Airways are all <a href="https://simpleflying.com/qatar-iata-travel-pass-launch/" rel="noopener noreferrer" target="_blank">expected</a> to start trialing the app in the next few weeks.<br></p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="5">
</div>
</div></p><p>In other instances, the technology will live inside other companies' existing apps; why make someone download yet another app and add another hurdle to compliance? Instead, the experience will be rather like adding a loyalty account or TSA PreCheck number when booking a flight. Airlines and other venues restricting access will require uploading negative test results or vaccine records using one of these services. "You're going to be using the United or the Delta app, and they'll be using our solution or somebody else's, but you will do it via their app," IATA's Travel Pass lead, Alan Murray Hayden, told Protocol.</p><p>The World Health Organization is also working on its own offering, and recently convened the <a href="https://www.who.int/groups/smart-vaccination-certificate-working-group" rel="noopener noreferrer" target="_blank">Smart Vaccination Certificate Working Group</a>. It's built upon the WHO's nearly century-old notion of the "yellow card" vaccination record, which first was used to document that travelers had been inoculated against diseases such as cholera and yellow fever. Evernym Chief Trust Officer Drummond Reed is part of the working group; he said there should be more to share in the coming months. </p><h3>What could go wrong?</h3><p>It's entirely possible that as more people start to get vaccinated, vaccine passports start to become the norm. You walk to work — still masked, of course — scan a QR code reader in the lobby, and are let in. You go out for lunch, and your loyalty card app has a discount for in-store shoppers verifying they're vaccinated. Your concert ticket is also tied to health pass information that you shared earlier in the day with Ticketmaster. But there are more than a few hurdles ahead of the companies rushing to turn these concepts into realities. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="6">
</div>
</div></p><p>First off, there's the … reality … of the real world that any digital system has to contend with. For anyone without access to the internet, digital vaccine credentials will prove difficult to acquire, though all the companies Protocol spoke with said they would offer a paper-based QR code for people who don't have smartphones. But there's also the issue of having to corral so many different stakeholders into one system, especially when some health care providers are still reliant on antiquated database systems or <a href="https://www.protocol.com/manuals/health-care-revolution/electronic-health-records-after-coronavirus" target="_self">even paper records</a>. "The amount of inefficiency in the system is tremendous," IBM's Piscini said. </p><p>But in the U.S. at least, all vaccinators are required to report COVID-19 vaccines to their state. Piscini said that even for people who just received a paper copy of their vaccine records, systems like IBM's can likely link up to the state's immunization registry and allow people to import records to a vaccine passport.</p><p class="shortcode-media shortcode-media-rebelmouse-image">
<img type="lazy-image" data-runner-src="https://www.protocol.com/media-library/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yNTY2NTc4My9vcmlnaW4ucG5nIiwiZXhwaXJlc19hdCI6MTYzNzg3MTM2M30.RZtqR7F_FuXK1S24V6jVaqUZ0xOSG-gCwj00xU3fxcM/image.png?width=980" id="b43ef" class="rm-shortcode" data-rm-shortcode-id="11d8002d92c0cd6ef39b12fc7b8dccf8" data-rm-shortcode-name="rebelmouse-image">
<small class="image-media media-caption" placeholder="Add Photo Caption...">How CommonPass's app shows your records. </small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Image: CommonPass</small></p><p>And states are willing to help out, Pollak said, adding that CommonPass has started working with Hawaii to roll out its offering for would-be tourists. "We're seeing a lot of state governments stepping up and doing a really good job with this," Pollak said. "It would be surprising if there wasn't a coordinated federal effort very soon." That being said, while <a href="https://www.cbc.ca/news/canada/north/iceland-covid-passports-canada-1.5904828" rel="noopener noreferrer" target="_blank">many countries around</a> the world are committing to working on vaccine passports, getting a straight answer out of the U.S. government on what it's doing has proven difficult. The State Department, which maintains America's traditional, analogue passports, referred me to Homeland Security, which referred me to the White House. The acting director and chief of staff of the White House's Office of Science and Technology Policy, Kei Koizumi, told Protocol that "OSTP can't discuss projects we are working on before they are publicly announced."</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="7">
</div>
</div></p><p>But even with systems in place at a federal level, there's still a fair amount of education that needs to happen before people will trust systems like these. "There's a substantial gap in understanding and knowledge of how these systems work, and people's views, in terms of who should get access to which data," Pollak said. </p><p>"We assume there's a Facebook Borg in the sky, monitoring every interaction," Smith said. "The emergence of verifiable credentials breaks down that mental model, where actually it becomes more like decentralized bits of paper that I can carry around, and no one's to know that I've been sharing this information."</p><p>"Our belief is that if you do the right thing, from a platform point of view, protecting your privacy, and giving you control and access to the platform to everybody who wants to use it," Piscini said. "I think those are very basic things that allow the core of the platform that we build to generate adoption by the individuals."</p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="8">
</div>
</div></p><p>Even with a system that works, there may still be holdouts to this potential new normal. "Some people are saying, 'I will never get vaccinated,'" Piscini said, "and I don't know if the airlines are going to say, 'Well, maybe you will never fly again.'"</p>
Keep Reading
Show less
Mike Murphy ( @mcwm) is the director of special projects at Protocol, focusing on the industries being rapidly upended by technology and the companies disrupting incumbents. Previously, Mike was the technology editor at Quartz, where he frequently wrote on robotics, artificial intelligence, and consumer electronics.
Google wants to connect everything you own to the internet
Surveilling older adults, connected helmets, wearables talking to doctors and other patents from Big Tech.
Make all the things smart!
Image: Google/USPTO
February 7, 2021
Mike Murphy ( @mcwm) is the director of special projects at Protocol, focusing on the industries being rapidly upended by technology and the companies disrupting incumbents. Previously, Mike was the technology editor at Quartz, where he frequently wrote on robotics, artificial intelligence, and consumer electronics.
February 7, 2021
Hello and welcome back to the world of zany patents from Big Tech! While 2020 is still dragging on (I know it's 2021, but you can't tell me 2020 is over until I can go anywhere other than the grocery store), at least there are still great new patents to uncover. And there's some fascinating ones this week, including Facebook wanting to make clothes like real in games, Microsoft trying to make sports more inclusive and Google wanting to make it easier to spy on your parents. If that's something you want to do.
And remember: The big tech companies file all kinds of crazy patents for things, and though most never amount to anything, some end up defining the future.
<h3>Alphabet</h3><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10909832&IDKey=E2C372F869B5%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D12%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dgoogle.ASNM.%2526OS%3DAN%2Fgoogle%2526RS%3DAN%2Fgoogle" rel="noopener noreferrer" target="_blank"><u><strong>Surveilling older adults</strong></u></a></p><p>People who have aging parents might find themselves checking in frequently to make sure Mom and Dad are OK, or even buying gadgets or products that make it a little easier to be self-sufficient. Google's solution, according to this patent, is a way to keep tabs on them remotely. Using smart sensors placed around the house, a system like Google Home could be set up to alert a third party about what's happening in the house. For example, the system can send an alert if it notices that nobody is moving around at specific times, and you can then decide whether to call or text to check in. Just be sure to ask your parents' permission first before you turn their home into a personal panopticon. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="1">
</div>
</div></p><p><img src="https://lh3.googleusercontent.com/aqPPk6Zx9eptCvcoH0C6gk9ttWQhaCtpeE8pxZjwGeI54BMZD60ZX3tMkzoTmRS-EOc3adg_0hEeJvy-guXvom7KGhlpLwEbPYmeEX-qZliYUB-9NJD8_XoFwbimneKW_yfHCK3s"></p><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10908732&IDKey=C0EE25D3B384%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D29%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dgoogle.ASNM.%2526OS%3DAN%2Fgoogle%2526RS%3DAN%2Fgoogle" target="_blank"><u><strong>Making analog products digital</strong></u></a></p><p>A few years ago, Google introduced Jacquard, its project for interweaving electronic sensors into fabrics. It's been used to add phone controls to denim jackets, bags and even shoes. It's a neat idea, but it requires you to buy new products that you might not actually want. With this patent, Google envisions bringing that same concept to any product you already own and making it smart. That could be things like touch sensors or tracking movement — perhaps you could just slap one of these on your parents instead of putting sensors all over their house. </p><p><img src="https://lh6.googleusercontent.com/bPwslTHzq2PFvILbefC4P8rID9ot4DROmm2HpREy8a2hT8N4nqoaNG7hsRUon0EUvTMIkEZx_GifA72qfM1vmVXE9iGIgqh0x-cIcz9QyoElPVewsZs-pEblxhUivDKSQwMLUR4S"></p><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10905328&IDKey=542E633FED99%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D6%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dverily.ASNM.%2526OS%3DAN%2Fverily%2526RS%3DAN%2Fverily" target="_blank"><u><strong>Keeping your doctor in the loop</strong></u></a></p><p>Alphabet's health research arm, Verily, is thinking about a future — which we <a href="https://www.protocol.com/manuals/health-care-revolution/future-of-health-care-wearables" target="_self"><u>might currently be living through</u></a> — where people don't need to get to the doctor to be diagnosed. This patent envisions a wearable that can constantly track your heart (it's unclear how much of a drain this would be on a small wearable battery), and identify any potential issues by consulting databases online, like if your data suggests that you might be having an arrhythmia. While there's a few wearables on the market that can do something like this right now, this patent imagines automatically sharing that data with your doctor, presumably so they could review the data, or potentially algorithmically warn you and your doctor that an emergency situation is underway. Hopefully it doesn't call your doctor <a href="https://twitter.com/mcwm/status/1170321867342843911" target="_blank"><u>if you suck at golf</u></a>, though. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="2">
</div>
</div></p><p><img src="https://lh5.googleusercontent.com/3avW8eqXPzgADxX3aAz9mt2_hYL9X0arzL_hrZD_E1U4WGceRmfAFtmOGRey5plQfwTeXvvk3RHdyzisWEDKdhuIZ1zVRrLCevaqO2XYPOvZ5CbJ-P-iezh6KzhLgGnttY98eXmY"></p><h3>Amazon</h3><p><a href="http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-adv.htm&r=64&f=G&l=50&d=PTXT&s1=amazon.ASNM.&p=2&OS=AN/amazon&RS=AN/amazon" target="_blank"><u><strong>Autonomous avoiding</strong></u></a></p><p>This one is conceptually quite straightforward, but important nonetheless when you're thinking about a phalanx of delivery drones flying around on their own. The patent outlines a laser range-finding system mounted on drone rotors that can help the drones "see" what's around them so they could shift their routes to avoid it. But for many in the drone industry, it's not really the tech that's holding back autonomous deliveries — <a href="https://www.protocol.com/alphabet-wing-drone-delivery-coronavirus" target="_self"><u>it's humans</u></a>. </p><p><img src="https://lh5.googleusercontent.com/BgpsJjJm62FynXbwVvwCY8gnA45ypo1HTs_SxBcZNfB1BuB0L824xC6ygkphev8sJPT55WEX-og5fNIzx3hvudtULw5pmx2HbaG_2S3Wmsifvq3TPtFVkZu074w4Fx10AuXeYnAX"></p><h3>Apple</h3><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10909389&IDKey=A422DE8D3462%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D49%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3D%252522apple%252Binc%252522.ASNM.%2526OS%3DAN%2F%252522apple%252Binc%252522%2526RS%3DAN%2F%252522apple%252Binc%252522" target="_blank"><u><strong>Detecting traffic wardens</strong></u></a></p><p>Rather like with autonomous delivery drones, it's good to know that Apple is thinking about what obstacles its autonomous vehicles might encounter. In this patent, it's specifically thinking about what to do when a car sees something that appears to be someone guiding traffic, and how to react to various hand signals they might make. This makes me think about a future where I could just carry a stop sign around with me and become the king of robot cars, directing them to follow my every whim. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="3">
</div>
</div></p><p><img src="https://lh4.googleusercontent.com/F6JQSxHys3DyDSpjetpIH9o_dffTSLDiU8OT5QBVw8-0Z41DPwI7d42RJAsJsbgoPG3f-iBMzo3vQiCCUWKxNlRPa1Vohgg2N_uLz51F_W0s9wA5Fm55k7DvbUax6hwYos5JlBIl"></p><h3>Facebook</h3><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10909744&IDKey=EF191432D67E%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D15%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dfacebook.ASNM.%2526OS%3DAN%2Ffacebook%2526RS%3DAN%2Ffacebook" target="_blank"><u><strong>Simulating clothing</strong></u></a></p><p>If you've ever played a video game where someone is wearing clothes (which is … most of them??), you've probably noticed that they don't exactly fall like the ones you wear IRL. I think my favorite example is uniforms in sports games; the systems usually recognize now that cloth stretches as people move, but then instead of just stretching the fabric, they'll stretch out the letters in players' names, making it look like the jerseys are made of elastic. Facebook's patent outlines a system that uses a machine learning-based "cloth simulator" to more realistically mimic how physics affects the wrinkles in simulated clothes. With Facebook's deep push into VR, this could be one of the things that helps the platform feel less like an awkward immersive video game and more like real life, represented in a headset. </p><p><img src="https://lh6.googleusercontent.com/hAYzpzP66pKPcM_kiwQSij5lS8BQNYz7uW0DU6jajuUZQU3lbxqzaZxmtsDrRaXBXRnua8ff8nanf1i0MMn_5AVlFuPRiQelhfpcNr2r_PbbT2qVV6lwcBukYMyv_c_UuoiM5-oF"></p><h3>Microsoft</h3><p><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10909321&IDKey=1CE7985A9F2E%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-adv.htm%2526r%3D52%2526f%3DG%2526l%3D50%2526d%3DPTXT%2526s1%3Dmicrosoft.ASNM.%2526p%3D2%2526OS%3DAN%2Fmicrosoft%2526RS%3DAN%2Fmicrosoft" target="_blank"><u><strong>An automatic travel diary</strong></u></a></p><p>When I was growing up, my mom used to make me write a diary anytime we went on vacation. It was a noble endeavor, but amazingly, my child brain was more interested in actually being on vacation than writing about it later. Regardless of what that might have meant from my chosen career, my adult brain is still a fan of this idea. The patent suggests a system that can auto-generate a travel diary based on your calls, texts, photos, location and other data from your phone. You could then share your digital diary with anyone you might want to make jealous — though you should probably consider whether giving over that much data to a system like this is worth the hate-likes. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="4">
</div>
</div></p><p><img src="https://lh4.googleusercontent.com/tV2JViV9zkMwQcQMg5nGU6-f9ijXqfIz79L47LV-utpG7-DY3Ll9-vovsj3Kp1piNzrFWq5vpka9NWGwbDoALamukQfBXOOZInqoCD5RWIN9wAHcmPmFhWDdOn-upm8_AYbgbo4B"></p><p><a href="http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=50&f=G&l=50&co1=AND&d=PTXT&s1=microsoft.ASNM.&OS=AN/microsoft&RS=AN/microsoft" target="_blank"><u><strong>Bringing sports to visually-impaired people</strong></u></a><br></p><p>If this could work, this could be a really neat way to make sports somewhat more inclusive. This patent envisions using sensors to help visually impaired people play sports. The example it gives includes something that looks a lot like an Xbox Kinect sensor built into a batting helmet. In the example, the helmet could provide a signal to the wearer that a pitch is incoming and it's time to swing. Alerts could be vibrations, sounds or other sensory flags. And although it might look odd to wear a batting helmet outside of the baseball diamond, the patent also envisions a system for other aspects of daily life, such as alerting the wearer when it's safe to cross the road. </p><p><img src="https://lh3.googleusercontent.com/mSxnCEL4X0Dm0lMpQ44R8ywUtfIYKOH5TA2rIOjAQa4rHmVDmenCuCTC6JuvEkxMrAFOPAo4ZWqqxtTb0HILAC_ZV3Y9dfbL8XIjNGjwRgibcmZWaOZ1P79j3obf2AgrRQNvoa4o"></p><p><br><a href="https://pdfpiw.uspto.gov/.piw?PageNum=0&docid=10909639&IDKey=8EBE02881232%0D%0A&HomeUrl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D42%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3Dmicrosoft.ASNM.%2526OS%3DAN%2Fmicrosoft%2526RS%3DAN%2Fmicrosoft" target="_blank"><u><strong>Icebreakers on social media</strong></u></a><br></p><p>If you've had to do any team-building exercises over Zoom during this pandemic, you've probably come across a few sessions of icebreaker questions. Maybe you've had to share what you'd take from your house in a fire, or what brands you unquestionably love. It's a sure-fire way to get people chatting. In this patent, Microsoft is envisioning bringing that energy into the rest of your life, whether on conversations you're having on social media, or even phone calls you're receiving. Pertinent information about friends, colleagues or new connections could be displayed next to their names on social media or when they're calling you, offering something to talk about other than work or the weather, like which marathons they've run or which '90s rock band they're still seeing live. </p><p><div class="ad-tag"><div class="ad-place-holder" data-pos="5">
</div>
</div></p><p><img src="https://lh3.googleusercontent.com/gwkWFM3icGcOxAU6vhUYW-4Ihx5hVa2_6PwS6UrTf20Z2dZVKGk7XApUq5zO6trRDDsn1X37myIE2R-9-gYIzvTFbnr_he_lJTObrsqYcuxOB5ZChGdQkF1dZKJ0UrUiTc-O_Ul7"></p>
Keep Reading
Show less
Mike Murphy ( @mcwm) is the director of special projects at Protocol, focusing on the industries being rapidly upended by technology and the companies disrupting incumbents. Previously, Mike was the technology editor at Quartz, where he frequently wrote on robotics, artificial intelligence, and consumer electronics.
Latest Stories
See more
Most Popular
Bulletins
Get Source Code in your inbox
David Pierce's daily analysis of the tech news that matters.