Power
Amazon wants to use delivery drones to surveil your house
Plus ads in AR, phones in VR, offline Siri and other patents from Big Tech.

One of Amazon's prototype delivery drones.
Photo: Amazon
Source Code: Your daily look at what matters in tech.
To give you the best possible experience, this site uses cookies. If you continue browsing. you accept our use of cookies. You can review our privacy policy to find out more about the cookies we use.
Plus ads in AR, phones in VR, offline Siri and other patents from Big Tech.
One of Amazon's prototype delivery drones.
It's that time of the week again. Take some time away from your busy Sunday to check out these weird and wonderful patents from Big Tech. As ever, there's a focus on augmented and virtual reality: Amazon is looking for how to advertise in AR, Facebook is looking into AR headphones, and Microsoft wants to turn your phone into a VR controller. And then there's Apple, which just wants to make your car's air conditioning a bit more enjoyable.
And remember: The big tech companies file all kinds of crazy patents for things, and though most never amount to anything, some end up defining the future.
Waymo won a design patent for a "3D sign," with no more information on what it's for in the document. It looks like a little pylon from football games, but it has … something … to do with self-driving cars. From one of the drawings, it looks like maybe a sign to show where you should stand to wait for a car, or where one will drop you off. Perhaps when things get back to normal and people start getting cabs again, we'll find out.
Have you ever tried to pay attention in a meeting while also taking notes? Maybe it's just me, but my brain refuses to think of creative things to say while also taking down what everyone else is saying. So something like what Google's new patent is suggesting would be super useful. The patent suggests a system where the meeting leader could set up a document, and anyone with a calendar event within proximity of their device gets access. They can all contribute to the document together in real time, adding notes together. The document could also suggest ways to make the notes more useful and accessible, easing some of the burden off my slow brain.
The concept behind this patent is pretty well covered at this point: using a virtual assistant listening to a text conversation between two people to suggest restaurants, movies and other things based on the conversation. But I had to share this example conversation in this patent. I don't know if this was written by computers trying to prove they can pass the Turing test or what, but I enjoy a good "movie = relax" and like finding discount on my shopping, too.
Putting ads on your body in AR
If AR becomes big, especially if AR glasses take off, it's almost a certainty that advertisers will glom onto it. When the internet shifted from the desktop to mobile, there was a big question around Google and Facebook's businesses and whether they would be able to shift with it. But that debate has long been settled, and it seems companies are already thinking about the next paradigm. Who isn't excited about the prospect of looking at their hands in AR and seeing banner ads plastered all over them? You'd look like a NASCAR driver at all times. There would be useful applications to technology like this, though, like using your hands as surfaces for controls in AR, but hopefully the ads won't get in the way.
In Amazon's vision of the future, drones are going to be blanketing the sky, delivering packages to us, day in, day out. According to this patent, as these drones proliferate, they could also be used for other purposes while they're flying around. Amazon envisions using the drones' cameras for home surveillance, scanning for things like broken windows and people on a property. Because who wouldn't want the company behind Ring and Rekognition to be scanning for whether you're home all the time?
If the flying surveillance drones weren't enough, Amazon is also looking into how to glean more information out of you from the devices in your house. Using camera and microphone sensors as well as radio-frequency detectors, you could theoretically ask Alexa things like, "Is someone in the living room?" Hopefully you get an answer you're expecting, especially if it's the middle of the night. Otherwise the next thing you're going to be asking Alexa is to call the cops.
Siri is sometimes there for you when you need a light turned on or a playlist shuffled, but it can only help when it has access to the internet. But there's a lot that would be helpful for it to do that wouldn't need the internet. Processors and GPUs are continually getting more powerful and efficient, to the point where the complex task of understanding people's voices can be done without having to call out to the cloud. Now, if someone could just make Siri a little more useful, internet or otherwise.
If you've ever been in a Tesla on a hot day, you've probably noticed that the air conditioning is a little more effective than in the average car. It seems that Apple (for the car it's definitely not maybe working on) might be working on something similar. Instead of having a few vents by the passengers, which never seem to hit you where you want them to (ever had freezing hands while driving and the rest of you is sweltering?), Apple's design, similar to Tesla's, seems to be for one long vent across the entirety of the front of the car, which could be directed exactly where you need air. I feel cooler already.
Facebook's patent revolves around a double-headphone system for AR glasses, relying on traditional earbuds mixed with bone-conduction headphones. But perhaps the most interesting part about this is that Facebook is exploring how its Oculus technology would work in glasses, rather than in a clunky VR headset.
Most VR inputs are wands with triggers on them. That's great for shooting things or chopping people down in VR worlds, but there's a lot of things you probably want to do that don't involve guns or swords. Microsoft is looking into ways to incorporate your cell phone as an input device that you can see in VR. That would allow you to type far easier, and do things like paint VR, if that's what you're into:
Mike Murphy ( @mcwm) is the director of special projects at Protocol, focusing on the industries being rapidly upended by technology and the companies disrupting incumbents. Previously, Mike was the technology editor at Quartz, where he frequently wrote on robotics, artificial intelligence, and consumer electronics.
Martin Cooper comes on the Source Code Podcast.
Martin Cooper with his original DynaTAC cell phone.
David Pierce ( @pierce) is Protocol's editor at large. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.
Martin Cooper helped invent one of the most consequential and successful products in history: the cell phone. And almost five decades after he made the first public cell phone call, on a 2-pound brick of a device called the DynaTAC, he's written a book about his career called "Cutting the Cord: The Cell Phone Has Transformed Humanity." In it he tells the story of the cell phone's invention, and looks at how it has changed the world and will continue to do so.
Cooper came on the Source Code Podcast to talk about his time at Motorola, the process of designing the first-ever cell phone, whether today's tech giants are monopolies and why he's bullish on the future of AI.
David Pierce ( @pierce) is Protocol's editor at large. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.
Tim Cook and Sundar Pichai praised President Biden's immigration actions, which read like a tech industry wishlist.
Newly-inaugurated President Joe Biden signed two immigration-related executive orders on Wednesday.
Emily Birnbaum ( @birnbaum_e) is a tech policy reporter with Protocol. Her coverage focuses on the U.S. government's attempts to regulate one of the most powerful industries in the world, with a focus on antitrust, privacy and politics. Previously, she worked as a tech policy reporter with The Hill after spending several months as a breaking news reporter. She is a Bethesda, Maryland native and proud Kenyon College alumna.
Immediately after being sworn in as president Wednesday, Joe Biden signed two pro-immigration executive orders and delivered an immigration bill to Congress that reads like a tech industry wishlist. The move drew enthusiastic praise from tech leaders, including Apple CEO Tim Cook and Alphabet CEO Sundar Pichai.
President Biden nullified several of former-President Trump's most hawkish immigration policies. His executive orders reversed the so-called "Muslim ban" and instructed the attorney general and the secretary of Homeland Security to preserve the Deferred Action for Childhood Arrivals, or DACA, program, which the Trump administration had sought to end. He also sent an expansive immigration reform bill to Congress that would provide a pathway to citizenship for undocumented individuals and make it easier for foreign U.S. graduates with STEM degrees to stay in the United States, among other provisions.
Emily Birnbaum ( @birnbaum_e) is a tech policy reporter with Protocol. Her coverage focuses on the U.S. government's attempts to regulate one of the most powerful industries in the world, with a focus on antitrust, privacy and politics. Previously, she worked as a tech policy reporter with The Hill after spending several months as a breaking news reporter. She is a Bethesda, Maryland native and proud Kenyon College alumna.
In conversation with Protocol, Commissioner Becca Slaughter, whose name has been floated as a possible FTC chair, laid out her priorities for the next four years.
FTC commissioner Becca Slaughter may be President Biden's pick for FTC chair.
Becca Slaughter, a commissioner for the Federal Trade Commission, made a name for herself last year when she famously breastfed her newborn baby during video testimony before the Senate, raising awareness about the plight of working parents during the pandemic.
But lately, Slaughter's name has been circulating for other reasons: She's a likely candidate to be President Joe Biden's pick for FTC chair, an appointment that would put Slaughter at the head of antitrust investigations into tech giants, including Facebook.
Anne Toth, Amazon's director of Alexa Trust, explains what it takes to get people to feel comfortable using your product — and why that is work worth doing.
Anne Toth, Amazon's director of Alexa Trust, has been working on tech privacy for decades.
David Pierce ( @pierce) is Protocol's editor at large. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.
Anne Toth has had a long career in the tech industry, thinking about privacy and security at companies like Yahoo, Google and Slack, working with the World Economic Forum and advising companies around Silicon Valley.
Last August she took on a new job as the director of Alexa Trust, leading a big team tackling a big question: How do you make people feel good using a product like Alexa, which is designed to be deeply ingrained in their lives? "Alexa in your home is probably the closest sort of consumer experience or manifestation of AI in your life," she said. That comes with data questions, privacy questions, ethical questions and lots more.
David Pierce ( @pierce) is Protocol's editor at large. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.
The current state-of-the-art quantum computers are a tangle of wires. And that can't be the case in the future.
The iconic image of quantum computing is the "Google chandelier," with its hundreds of intricately arranged copper wires descending like the tendrils of a metallic jellyfish. It's a grand and impressive device, but in that tangle of wires lurks a big problem.
"If you're thinking about the long-term prospects of quantum computing, that image should be just terrifying," Jim Clarke, the director of quantum hardware at Intel, told Protocol.