Amazon has a new plan for drone home delivery: Radar landing pads

Plus, Apple patented styluses that feel like real pens; Microsoft might be reviving the ghost of AIM; and Waymo wants to protect you from self-driving car crashes.

Five drones fly over a city

Two new patents from Amazon could get the delivery giant closer to this kind of imagined future.

Photo: Hiroshi Watanabe/Getty Images

Another week in self-isolation, and another week of solid patents from big tech. Amazon is getting serious about automating the last leg of delivery. Alphabet is designing a seat-scrambling system for self-driving cars. A surprising number of patents discussed styluses, which may be coming back in a big way — and so might AOL Instant Messenger, too. A bunch of patents also dive into new uses for VR, which is a technology that seemed absolutely ripe to take off during this time when no one can go outside, but still hasn't. Maybe what it needed can be found in the files of the U.S. Patent and Trademark Office.

And remember: The big tech companies file all kinds of crazy patents for things, and though most never amount to anything, some end up defining the future.


Moving self-driving car seats to protect passengers

Most companies working on autonomous vehicles like to talk about how they can rearrange the layout of the seats in the vehicle to make them more comfortable for the passengers, and more conducive to chatting or working than a regular car. But Waymo's new patent has another goal in mind: safety. The patent suggests a system in self-driving cars that would be able to dynamically change the seat layout. If the car sensed that a crash was imminent, it could quickly arrange seats to protect all the human passengers inside as much as possible. If the car has time to do this, one might wonder, why can't it just get out of the way of the crash?

Tracking your hands

If you've ever done anything in VR, you know that holding a device to replicate your hands works only OK. Google's new patent suggests a better alternative: your actual hands. It's not the first time someone has suggested using sensors to capture the motion of your hands to control virtual worlds — startup Leap Motion tried to turn that into a reality — but existing systems have had issues with latency and fidelity. Google's idea would apparently track each individual section of each finger to allow for more accurate tracking. Perhaps in the near future, using VR won't feel as clunky as trying to lead a blind bull through a china shop.

Using Google Assistant like a highlighter

This is one of the most novel uses I've seen for a stylus in a long time. My handwriting is terrible, and I can't draw, so I have little use for styluses personally, but this Google patent might change my mind. It envisions being able to call on Google Assistant by drawing a circle around something on your screen in a specific way. In one of the examples in the patent, a user is chatting with someone who asks him for his flight number; instead of leaving the app and going to search for it, the person circles the question, which triggers the Assistant (and it being Google, it's already connected up to his Gmail), and it pulls up the answer. It seems a lot simpler than typing that into Google or asking the same question out loud, which always feels rather awkward, even when you're alone.


Radar landing pads for drones

With everything that's going on right now, a lot of people probably wish a drone could deliver them groceries instead of having to battle it out in the real world or wait for a delivery slot to open up. But landing autonomous drones in someone's backyard without killing anyone or crashing into anything is a fair bit harder than it sounds. One solution Amazon appears to be looking at is placing radar devices at landing sites, which could bounce signals to a drone to let it know where to land or things to avoid. In one drawing in the patent, that just looks like a sheet with a massive "X" in the middle of it. Hopefully when the drone comes in for a landing, it'll say something like, "Ahoy, me mateys, here's yer treasure!"

Amazon was also awarded another patent this week for using image-based codes to direct drones around, which would probably be helpful for the aircraft when they're maneuvering their way out of an Amazon facility and off to deliver their booty.

Shopping Amazon in VR

Have you ever gone to Amazon's website and thought, "I really wish this was blown out into a series of modules across my entire field of view?" No? Weird. Well, a new patent from Amazon gives an indication of what shopping on the site might look like in VR. And much like every '90s skeuomorphic vision of future computer systems, the patent envisions virtually re-creating things like coffee shops or parks to do our shopping in. Then as you move your head around, you'd see all sorts of items floating in front of you to buy — it's a lot like that famous scene in "Minority Report," except instead of trying to prevent murders, you're stocking back up on toilet paper.

Bringing the Amazon warehouse to your driveway

Modern Amazon warehouses are filled with hundreds of tiny robots that move giant racks of products around in silence so that humans can sort everything into boxes to send to you. Amazon's new patent imagines cutting out a few stages, namely: getting rid of those pesky humans. Instead, the patent suggests using robots to load shelves of products onto trucks, and then autonomously dropping them off at your driveway for you to take the products. Hopefully you're fine with sorting your own packages and having a rack sit in your driveway for a while.

Turning roadways into train tracks for autonomous vehicles

One way to help self-driving cars navigate the world they're driving in is to provide them with maps of what they're going to see and let them plan their trip from there. Amazon's patent takes that idea a little further, using one autonomous vehicle to lay down a map of the route for a second vehicle to follow, like a set of train tracks. It would almost be like racing your ghost in Mario Kart, but for convoys of autonomous vehicles.

Using drones to map the world

One of the great things about robots is that you can tell them to do multiple things at once. Amazon's patent suggests that while drones are out delivering you your packages, they can also be scanning the world below them to make better topographical maps. The patent also suggests that other types of aircraft, from personal drones to helicopters, could be doing the same thing while they're up in the sky. This probably won't do much to allay the worries of privacy advocates who aren't fans of the idea of drones constantly surveilling the world below them as they pass, though.


Making styluses feel more real

Apple was famously against styluses for the longest time — until other companies started making devices with styluses that people seemed to like. But the Apple Pencil, like just about every other stylus on the market today, suffers from the fact that it doesn't really feel like you're drawing with a pencil; you're rubbing a piece of plastic against a piece of glass. This new patent from Apple explores how you could change that with haptic feedback, either using small vibrations or magnets. That doesn't mean Steve Jobs wouldn't still hate it, though.

Why not just write on paper?

Coincidentally, Apple has another patent out this week that could replicate the sensation of real drawing in a totally different way: by just writing on whatever surface you like. In the patent, Apple outlines an input device (like a stylus) that can gauge things like pressure, when the stylus is being used to draw and when it's just sitting there. This could actually be really useful with a computer rather than a tablet. Most designers today use something like a Wacom tablet to digitize their drawings, but it'd be a lot simpler if you could take the same stylus you use on an iPad, pair it with your Mac, and start digitally drawing on a physical piece of paper in front of you.

A lanyard worthy of Jony Ive

Some of my favorite Apple patents — of which there are many! — are the design patents the company files for extremely basic stuff that it refuses to just buy from a store like anyone else. Why buy plant pots (like we saw last week) when you can get some of the best product designers in the world to use their time to do it instead? Same goes for a lanyard and part of a gift card this week. The lanyard has 17 people listed as inventors, including former Apple design chief Jony Ive. I would love to have seen what the meeting to design this thing was like.


A digital reference card

Facebook got a patent this week that would provide crucial context about who people and organizations are on the platform. It suggests creating information snippets for search results. The example it gives is someone searching for "oculus new headset." The site returns a bunch of results that mention Facebook and Mark Zuckerberg, and you could get some helpful information if you scrolled over highlighted names. You'd learn that Mark Zuckberg is the CEO of the parent company of Oculus, which is indeed Facebook. This could be helpful in addressing some of the spread of false or misleading information on the platform. But I think my favorite part of this patent is all the references in the example it uses to employees of Oculus who are no longer at the company, like Brendan Iribe and Palmer Luckey, who left under … very different circumstances.


The future of Microsoft Teams is … AOL Instant Messenger?

This is a funny one: It seems that at some point, Microsoft acquired a patent from AOL that's only been published this week. The listed inventor, Patrick Blattner, worked in product management for AOL at the start of the 2000s, and all the drawings in the patent clearly show AIM, rather than any Microsoft product, like MSN Messenger. The patent comes from a simpler time in internet communication, when we would use emoji on AIM to describe our moods — here, it outlines a system where emoji avatars can be changed based on the users' perceived moods. It's not clear why Microsoft would want to push ahead with this patent (other than just to have it), but some small part of me hopes that a future version of Microsoft Teams brings back away messages where we *~aLL tAlK LikE tHiS~*


Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep ReadingShow less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep ReadingShow less
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep ReadingShow less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep ReadingShow less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.


Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep ReadingShow less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories