Apple wants to make phones work underwater

Inflatable boxes, insect traps, infinite crossword puzzles and other patents from Big Tech.

Apple has taken out a patent on a technique for making touchscreens work underwater.

Swiping with the fishes.

Source: USPTO/Apple

Hello and welcome to the last edition of the Big Tech patent roundup! Sadly as you read this, I'll have moved on from Protocol, but I couldn't head out without doing one more patent roundup. It just didn't feel right. So this is a bumper issue, with zany patents like an inflatable box from Amazon, underwater iPhones and insect traps from Microsoft. Hopefully these are enough to tide you over for … forever.

And remember: The big tech companies file all kinds of crazy patents for things, and though most never amount to anything, some end up defining the future.

Alphabet

AR menus

Have you ever been to a diner with a giant, pages-long menu that has pictures of all their best sellers? They definitely make choosing easier, but it also makes the menu as long as the bible. This new idea from Google could make things simpler: The patent outlines a system for using codes on regular menus that could be scanned and, through a phone's camera, use AR to show what each dish looks like, without having to take up all the space on the menu. Assuming we ever go back to paper menus, that is.

Recommending cover songs based on what you've just listened to

I could see this being really useful to Taylor Swift fans right now. Say you've just mainlined "You Belong With Me" but realize it's the version that Taylor Swift no longer owns, so the streaming service you're listening on recommends you listen to the new "Taylor's Version," along with some other great covers of it. That's basically the gist of this patent: finding covers of songs you love that you might also enjoy. It's also a great way to find new artists similar to ones you already love.

Writing apps with human language

Have you ever tried to write a program? Chances are if you're a Protocol reader, you might have. It's quite difficult! It's the reason programming is such a specialized, in-demand profession. But advances in natural-language understanding and processing could mean that it's not long before anyone with an idea can turn it into an app. That's basically what this patent suggests, using a system that can understand simple commands, and turn them into a program people can use. One of the examples given is to streamline a company's order process, tracking all orders and flagging complicated ones as high priority, which a person describes to the system, and it executes — no coding knowledge required.



Crossword puzzle generator

If you are addicted to crosswords, and finish the ones in your daily paper before your morning coffee, perhaps this patent could be for you. It envisions a system that can auto-generate crossword puzzles based on the headlines of the day, primarily using the proper nouns that the software finds in news articles. Given how much seems to be going on every single day these days, this could mean there's a near-endless stream of puzzles to satiate even the most ardent cruciverbalists.

Amazon

Group voice chats

Are party lines still a thing? I guess that's basically what Clubhouse is, just in a $4 billion app. If you want to recreate that vibe at home, sitting on the couch and not feeling like reaching for your phone, perhaps in the future you'll be able to just call on Alexa. You can already do a voice call to anyone with an Alexa-enabled device, but this patent envisions being able to add others to your call, much like the characters in the dystopian drama "Years and Years" do with their voice assistants. Hopefully your group calls won't also include the disembodied voice of dead aunts who have been recreated in an Al netherworld.

Inflatable shipping containers

This is a pretty nifty idea for cutting down on the massive amounts of cardboard and packing materials that Amazon uses every single day. Instead of the traditional cardboard box filled with bubble wrap, this design involves two pieces of a harder material flat-packed with a flexible middle material that can be inflated. The box can then be sealed and shipped off the customer, who can then reuse the packaging or theoretically send it back to Amazon. I'm not sure how seamless the return logistics would be here, but if Amazon could figure it out, it could be a serious boon to the world's trees.

Apple

Using your iPhone underwater

Most iPhones and Apple Watches from the last few years have been water-resistant enough that a dip in the pool with one won't damage them, but actually using one underwater has been near impossible. While you're not likely going to start answering emails while scuba diving, it might be nice to be able to snap a photo or two, and this patent envisions being able to do just that. You'd let the device know that you're about to go underwater, which would tell it to basically decrease the touchscreen's sensitivity, where it only registers the very firm press of a finger on the screen as an input, rather than all the water washing against it. Now your colleagues will have to guess whether that underwater Zoom background is truly real or fake.

Haptic vibrations for AirPods

Apple is exploring how haptic notifications would work for things like AirPods, AR glasses and other head-worn devices. In this patent, it looks into exploring adding vibrations to these devices to help draw the wearer's attention to something. In the case of AirPods, it could be that only the right earpiece buzzes, which alerts the user to look up to the right. That could be because someone in front of them is speaking, or perhaps because they're playing a VR game and the haptics are guiding them to look at a certain area of the display to check out an incoming message. It'll be like an Apple Watch, but inside your ear canal.

Intelligently reminding you to charge your devices

There are two types of people in the world: those who plug their phone in every night when they go to bed, and those who just wing it. Either way, you likely have rather distinct usage patterns for when you need your phone and when it's sitting idle. Instead of just getting a notification that your phone is nearly dead, this patent outlines a system that would notify users (hopefully on another device) that they should probably plug in their phone now if they want it to be charged for when they're next likely going to need it. Hopefully they heed those advance warnings, or they could just learn to be sensible and plug their phone in at night.

Apple Watch packaging

I've poked fun at Apple many times over the years for patenting some pretty inconsequential things, like lanyards, paper bags and those wooden cubes that are impossible to sit on at Apple Stores. But this design patent for the Apple Watch packaging is actually worth it. It's a lovely design that unfolds around the watch as you open it, unlike the iPhone box, which is just a rectangle that's difficult to open because the lid is sealed on so tightly.

Facebook

Crowdsourced geolocation … for ads

Several companies, including Apple, have started exploring the idea of using anonymous crowdsourced location data to help you find your lost gadgets. Facebook appears to be jumping on this trend, but in typical Facebook fashion, it's just to sell ads better. In the scenario laid out by the patent, a person could be walking nearby a store, and even though you've not interacted with it, beacons in the store could ping nearby devices, which could then triangulate that you're nearby (using Bluetooth or Wi-Fi) and push you deals enticing you to come in. Maybe you'll actually want to lose your devices soon.

Automated newsfeed across all apps

Facebook has long been characterized by its News Feed, a Facebook-defined list of the best posts by the people you follow. It seems that the company is interested in taking this idea even further, pulling in updates from every app on your phone. While it might be somewhat concerning that Facebook envisions giving the headlines from the news apps you follow the same weight as the dessert your friend just posted on Instagram, the names for the fake apps in its examples in the patent are amazing. Do you just love listening to music on Sportify and posting photos on Introgram?

Microsoft

An insect trap

I'm not entirely sure why Microsoft has gotten into the field of predicting epidemics (feel like there's one it might've missed, I'm not sure?), but apparently it has. This patent describes a novel design for trapping mosquitoes to study the diseases they carry, to help prevent their spread to humans. One thing that's for certain: It has windows.

Browsing on multiple devices at once

Have you ever tried to get something important done on your phone? Half the time, the mobile site is terrible and you can't get whatever you need to do to load properly. Or have you ever tried to do just about anything on a smart TV only to realize that typing using an on-screen keyboard is the slowest, dullest activity on Earth? This patent envisions taking the best parts of various modalities and turning them into one experience. Say you're browsing on your phone and want to use a larger display: The system in Microsoft's patent could toss the part of the page you want to see (like a movie or your calendar) onto the big screen, while leaving the part you need to interact with (like a keyboard) on your smartphone. It's the best of both worlds. Now, where's my Lumia?

Policy

Google is wooing a coalition of civil rights allies. It’s working.

The tech giant is adept at winning friends even when it’s not trying to immediately influence people.

A map display of Washington lines the floor next to the elevators at the Google office in Washington, D.C.

Photo: Andrew Harrer/Bloomberg via Getty Images

As Google has faced intensifying pressure from policymakers in recent years, it’s founded trade associations, hired a roster of former top government officials and sometimes spent more than $20 million annually on federal lobbying.

But the company has also become famous in Washington for nurturing less clearly mercenary ties. It has long funded the work of laissez-faire economists who now defend it against antitrust charges, for instance. It’s making inroads with traditional business associations that once pummeled it on policy, and also supports think tanks and advocacy groups.

Keep Reading Show less
Ben Brody

Ben Brody (@ BenBrodyDC) is a senior reporter at Protocol focusing on how Congress, courts and agencies affect the online world we live in. He formerly covered tech policy and lobbying (including antitrust, Section 230 and privacy) at Bloomberg News, where he previously reported on the influence industry, government ethics and the 2016 presidential election. Before that, Ben covered business news at CNNMoney and AdAge, and all manner of stories in and around New York. He still loves appearing on the New York news radio he grew up with.

Sustainability. It can be a charged word in the context of blockchain and crypto – whether from outsiders with a limited view of the technology or from insiders using it for competitive advantage. But as a CEO in the industry, I don’t think either of those approaches helps us move forward. We should all be able to agree that using less energy to get a task done is a good thing and that there is room for improvement in the amount of energy that is consumed to power different blockchain technologies.

So, what if we put the enormous industry talent and minds that have created and developed blockchain to the task of building in a more energy-efficient manner? Can we not just solve the issues but also set the standard for other industries to develop technology in a future-proof way?

Keep Reading Show less
Denelle Dixon, CEO of SDF

Denelle Dixon is CEO and Executive Director of the Stellar Development Foundation, a non-profit using blockchain to unlock economic potential by making money more fluid, markets more open, and people more empowered. Previously, Dixon served as COO of Mozilla. Leading the business, revenue and policy teams, she fought for Net Neutrality and consumer privacy protections and was responsible for commercial partnerships. Denelle also served as general counsel and legal advisor in private equity and technology.

Workplace

Everything you need to know about tech layoffs and hiring slowdowns

Will tech companies and startups continue to have layoffs?

It’s not just early-stage startups that are feeling the burn.

Photo: Kirsty O'Connor/PA Images via Getty Images

What goes up must come down.

High-flying startups with record valuations, huge hiring goals and ambitious expansion plans are now announcing hiring slowdowns, freezes and in some cases widespread layoffs. It’s the dot-com bust all over again — this time, without the cute sock puppet and in the midst of a global pandemic we just can’t seem to shake.

Keep Reading Show less
Nat Rubio-Licht

Nat Rubio-Licht is a Los Angeles-based news writer at Protocol. They graduated from Syracuse University with a degree in newspaper and online journalism in May 2020. Prior to joining the team, they worked at the Los Angeles Business Journal as a technology and aerospace reporter.

Entertainment

Sink into ‘Love, Death & Robots’ and more weekend recs

Don’t know what to do this weekend? We’ve got you covered.

Our favorite picks for your weekend pleasure.

Image: A24; 11 bit studios; Getty Images

We could all use a bit of a break. This weekend we’re diving into Netflix’s beautifully animated sci-fi “Love, Death & Robots,” losing ourselves in surreal “Men” and loving Zelda-like Moonlighter.

Keep Reading Show less
Nick Statt

Nick Statt is Protocol's video game reporter. Prior to joining Protocol, he was news editor at The Verge covering the gaming industry, mobile apps and antitrust out of San Francisco, in addition to managing coverage of Silicon Valley tech giants and startups. He now resides in Rochester, New York, home of the garbage plate and, completely coincidentally, the World Video Game Hall of Fame. He can be reached at nstatt@protocol.com.

Workplace

This machine would like to interview you for a job

Companies are embracing automated video interviews to filter through floods of job applicants. But interviews with a computer screen raise big ethical questions and might scare off candidates.

Although automated interview companies claim to reduce bias in hiring, the researchers and advocates who study AI bias are these companies’ most frequent critics.

Photo: Johner Images via Getty Images

Applying for a job these days is starting to feel a lot like online dating. Job-seekers send their resume into portal after portal and a silent abyss waits on the other side.

That abyss is silent for a reason and it has little to do with the still-tight job market or the quality of your particular resume. On the other side of the portal, hiring managers watch the hundreds and even thousands of resumes pile up. It’s an infinite mountain of digital profiles, most of them from people completely unqualified. Going through them all would be a virtually fruitless task.

Keep Reading Show less
Anna Kramer

Anna Kramer is a reporter at Protocol (Twitter: @ anna_c_kramer, email: akramer@protocol.com), where she writes about labor and workplace issues. Prior to joining the team, she covered tech and small business for the San Francisco Chronicle and privacy for Bloomberg Law. She is a recent graduate of Brown University, where she studied International Relations and Arabic and wrote her senior thesis about surveillance tools and technological development in the Middle East.

Latest Stories
Bulletins