yesMike MurphyNone
×

Get access to Protocol

I’ve already subscribed

Will be used in accordance with our Privacy Policy

Power

Amazon wants to use delivery drones to surveil your house

Plus ads in AR, phones in VR, offline Siri and other patents from Big Tech.

Amazon wants to use delivery drones to surveil your house

One of Amazon's prototype delivery drones.

Photo: Amazon

It's that time of the week again. Take some time away from your busy Sunday to check out these weird and wonderful patents from Big Tech. As ever, there's a focus on augmented and virtual reality: Amazon is looking for how to advertise in AR, Facebook is looking into AR headphones, and Microsoft wants to turn your phone into a VR controller. And then there's Apple, which just wants to make your car's air conditioning a bit more enjoyable.

And remember: The big tech companies file all kinds of crazy patents for things, and though most never amount to anything, some end up defining the future.

Alphabet

A cryptic Waymo sign

Waymo won a design patent for a "3D sign," with no more information on what it's for in the document. It looks like a little pylon from football games, but it has … something … to do with self-driving cars. From one of the drawings, it looks like maybe a sign to show where you should stand to wait for a car, or where one will drop you off. Perhaps when things get back to normal and people start getting cabs again, we'll find out.

Auto-generated meeting notes

Have you ever tried to pay attention in a meeting while also taking notes? Maybe it's just me, but my brain refuses to think of creative things to say while also taking down what everyone else is saying. So something like what Google's new patent is suggesting would be super useful. The patent suggests a system where the meeting leader could set up a document, and anyone with a calendar event within proximity of their device gets access. They can all contribute to the document together in real time, adding notes together. The document could also suggest ways to make the notes more useful and accessible, easing some of the burden off my slow brain.

Suggested events

The concept behind this patent is pretty well covered at this point: using a virtual assistant listening to a text conversation between two people to suggest restaurants, movies and other things based on the conversation. But I had to share this example conversation in this patent. I don't know if this was written by computers trying to prove they can pass the Turing test or what, but I enjoy a good "movie = relax" and like finding discount on my shopping, too.

Amazon

Putting ads on your body in AR

If AR becomes big, especially if AR glasses take off, it's almost a certainty that advertisers will glom onto it. When the internet shifted from the desktop to mobile, there was a big question around Google and Facebook's businesses and whether they would be able to shift with it. But that debate has long been settled, and it seems companies are already thinking about the next paradigm. Who isn't excited about the prospect of looking at their hands in AR and seeing banner ads plastered all over them? You'd look like a NASCAR driver at all times. There would be useful applications to technology like this, though, like using your hands as surfaces for controls in AR, but hopefully the ads won't get in the way.

Home security via drone

In Amazon's vision of the future, drones are going to be blanketing the sky, delivering packages to us, day in, day out. According to this patent, as these drones proliferate, they could also be used for other purposes while they're flying around. Amazon envisions using the drones' cameras for home surveillance, scanning for things like broken windows and people on a property. Because who wouldn't want the company behind Ring and Rekognition to be scanning for whether you're home all the time?

Alexa knows when you're home

If the flying surveillance drones weren't enough, Amazon is also looking into how to glean more information out of you from the devices in your house. Using camera and microphone sensors as well as radio-frequency detectors, you could theoretically ask Alexa things like, "Is someone in the living room?" Hopefully you get an answer you're expecting, especially if it's the middle of the night. Otherwise the next thing you're going to be asking Alexa is to call the cops.

Apple

Siri, offline

Siri is sometimes there for you when you need a light turned on or a playlist shuffled, but it can only help when it has access to the internet. But there's a lot that would be helpful for it to do that wouldn't need the internet. Processors and GPUs are continually getting more powerful and efficient, to the point where the complex task of understanding people's voices can be done without having to call out to the cloud. Now, if someone could just make Siri a little more useful, internet or otherwise.

A Tesla-like A/C system

If you've ever been in a Tesla on a hot day, you've probably noticed that the air conditioning is a little more effective than in the average car. It seems that Apple (for the car it's definitely not maybe working on) might be working on something similar. Instead of having a few vents by the passengers, which never seem to hit you where you want them to (ever had freezing hands while driving and the rest of you is sweltering?), Apple's design, similar to Tesla's, seems to be for one long vent across the entirety of the front of the car, which could be directed exactly where you need air. I feel cooler already.

Facebook

Headphones for AR glasses

Facebook's patent revolves around a double-headphone system for AR glasses, relying on traditional earbuds mixed with bone-conduction headphones. But perhaps the most interesting part about this is that Facebook is exploring how its Oculus technology would work in glasses, rather than in a clunky VR headset.

Microsoft

Using your phone in VR

Most VR inputs are wands with triggers on them. That's great for shooting things or chopping people down in VR worlds, but there's a lot of things you probably want to do that don't involve guns or swords. Microsoft is looking into ways to incorporate your cell phone as an input device that you can see in VR. That would allow you to type far easier, and do things like paint VR, if that's what you're into:

Martin Cooper with his original DynaTAC cell phone.

Photo: Ted Soqui/Getty Images

Martin Cooper helped invent one of the most consequential and successful products in history: the cell phone. And almost five decades after he made the first public cell phone call, on a 2-pound brick of a device called the DynaTAC, he's written a book about his career called "Cutting the Cord: The Cell Phone Has Transformed Humanity." In it he tells the story of the cell phone's invention, and looks at how it has changed the world and will continue to do so.

Cooper came on the Source Code Podcast to talk about his time at Motorola, the process of designing the first-ever cell phone, whether today's tech giants are monopolies and why he's bullish on the future of AI.

Keep Reading Show less
David Pierce

David Pierce ( @pierce) is Protocol's editor at large. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.

Big Tech gets a win from Biden’s sweeping immigration actions

Tim Cook and Sundar Pichai praised President Biden's immigration actions, which read like a tech industry wishlist.

Newly-inaugurated President Joe Biden signed two immigration-related executive orders on Wednesday.

Photo: Chip Somodevilla/Getty Images

Immediately after being sworn in as president Wednesday, Joe Biden signed two pro-immigration executive orders and delivered an immigration bill to Congress that reads like a tech industry wishlist. The move drew enthusiastic praise from tech leaders, including Apple CEO Tim Cook and Alphabet CEO Sundar Pichai.

President Biden nullified several of former-President Trump's most hawkish immigration policies. His executive orders reversed the so-called "Muslim ban" and instructed the attorney general and the secretary of Homeland Security to preserve the Deferred Action for Childhood Arrivals, or DACA, program, which the Trump administration had sought to end. He also sent an expansive immigration reform bill to Congress that would provide a pathway to citizenship for undocumented individuals and make it easier for foreign U.S. graduates with STEM degrees to stay in the United States, among other provisions.

Keep Reading Show less
Emily Birnbaum

Emily Birnbaum ( @birnbaum_e) is a tech policy reporter with Protocol. Her coverage focuses on the U.S. government's attempts to regulate one of the most powerful industries in the world, with a focus on antitrust, privacy and politics. Previously, she worked as a tech policy reporter with The Hill after spending several months as a breaking news reporter. She is a Bethesda, Maryland native and proud Kenyon College alumna.

Politics

Is this the future of the FTC?

In conversation with Protocol, Commissioner Becca Slaughter, whose name has been floated as a possible FTC chair, laid out her priorities for the next four years.

FTC commissioner Becca Slaughter may be President Biden's pick for FTC chair.

Photo: David Becker/Getty Images

Becca Slaughter, a commissioner for the Federal Trade Commission, made a name for herself last year when she famously breastfed her newborn baby during video testimony before the Senate, raising awareness about the plight of working parents during the pandemic.

But lately, Slaughter's name has been circulating for other reasons: She's a likely candidate to be President Joe Biden's pick for FTC chair, an appointment that would put Slaughter at the head of antitrust investigations into tech giants, including Facebook.

Keep Reading Show less
Issie Lapowsky
Issie Lapowsky (@issielapowsky) is a senior reporter at Protocol, covering the intersection of technology, politics, and national affairs. Previously, she was a senior writer at Wired, where she covered the 2016 election and the Facebook beat in its aftermath. Prior to that, Issie worked as a staff writer for Inc. magazine, writing about small business and entrepreneurship. She has also worked as an on-air contributor for CBS News and taught a graduate-level course at New York University’s Center for Publishing on how tech giants have affected publishing. Email Issie.
People

Amazon’s head of Alexa Trust on how Big Tech should talk about data

Anne Toth, Amazon's director of Alexa Trust, explains what it takes to get people to feel comfortable using your product — and why that is work worth doing.

Anne Toth, Amazon's director of Alexa Trust, has been working on tech privacy for decades.

Photo: Amazon

Anne Toth has had a long career in the tech industry, thinking about privacy and security at companies like Yahoo, Google and Slack, working with the World Economic Forum and advising companies around Silicon Valley.

Last August she took on a new job as the director of Alexa Trust, leading a big team tackling a big question: How do you make people feel good using a product like Alexa, which is designed to be deeply ingrained in their lives? "Alexa in your home is probably the closest sort of consumer experience or manifestation of AI in your life," she said. That comes with data questions, privacy questions, ethical questions and lots more.

Keep Reading Show less
David Pierce

David Pierce ( @pierce) is Protocol's editor at large. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.

The current state-of-the-art quantum computers are a tangle of wires. And that can't be the case in the future.

Photo: IBM Research

The iconic image of quantum computing is the "Google chandelier," with its hundreds of intricately arranged copper wires descending like the tendrils of a metallic jellyfish. It's a grand and impressive device, but in that tangle of wires lurks a big problem.

"If you're thinking about the long-term prospects of quantum computing, that image should be just terrifying," Jim Clarke, the director of quantum hardware at Intel, told Protocol.

Keep Reading Show less
Dan Garisto
Dan Garisto is a freelance science journalist who specializes in the physical sciences, with an emphasis on particle physics. He has an undergraduate degree in physics and is based in New York.
Latest Stories