Apple wants to put a computer on your finger

Plus, book chat groups, bendable styluses and "Alice in Wonderland" in patents.

Apple Watch Series 5

Like this, but even smaller.

Photo: Apple

It's the weekend, which means it's again time to switch from your bad screen to your good screen. It also means a whole new slew of patents from the U.S.' biggest tech companies is here, and there were some truly zany things going on this week. Apple wants to make an Apple Watch for your finger; Google wants to cover your house in ads; Amazon wants us to argue about "Harry Potter"; Microsoft wants to keep you alive in VR; and Facebook put the characters from "Alice in Wonderland" in Messenger for some reason.

And remember: The big tech companies file all kinds of crazy patents for things, and though most never amount to anything, some end up defining the future.


Removing human interaction from your life

Google has been working on Duplex, its AI assistant that can call businesses and make reservations on behalf of a user, for a little while now — with mixed results. The company's patent from this week explains the system in more detail, and how the assistant could theoretically call every Chinese restaurant in your town to find out which has availability that evening. If it worked as envisioned, it would be a technical marvel that would almost certainly mean you would never have to talk to a maitre d' again, and also probably annoy every business in town.

Surrounded by ads

When our devices can talk to each other, they can perform useful tasks like turning on the lights, lowering the heat, or even switching channels on the TV. Now it's apparently (and inevitably) time for our interconnected devices to become digital billboards. In this patent, Google outlines a system where a user could be watching a show on one device — like a smart TV or phone — and when an ad displays, it could show related content, such as a shopping link or an instructional video, on other screens on your network. It'd be like Times Square in your living room, when all you wanted to do was catch up on "Ozark."

Robotic surgeries

Although Verily got out of Verb Surgical, its joint-venture with Johnson & Johnson exploring robotic surgeries, it's still pursuing patents around surgical bots. It was recently awarded one that describes how a robot could be used to dissect tissues, either for procedures like biopsies or to help out in surgeries. The system could use computer vision and rough instructions from a person on the areas they would like the robot to cut, presumably with greater accuracy than a human surgeon could. The robot could also image the tissue it's cutting, which could help doctors diagnose their patients. I hope in the future Verily's former sister company provides the robots, so after they perform a successful surgery, they can do a few backflips.


Robots that suck

In its quest to automate the entire retail process, one of Amazon's biggest sticking points is that not every object it sells comes in a nice square box. Humans are very good at being able to quickly understand how to pick something up, thanks to millennia of evolution. Robots, on the other hand, aren't very good at adapting. Teach them to pick up a box and they'll be able to do it forever, but if you then tell them to pick up a football, they'll struggle. Amazon has been trying for years to replace the humans who pack its boxes with robots. And a patent published this week suggests a breakthrough might be around the corner. It outlines a robotic arm with a suction system attached to the end that can form around uneven surfaces, kind of like picking something up with your mouth. Not that I've ever tried to do that.

Chatting through book recommendations

If you're after something a little deeper than the star-rating system Amazon currently uses, perhaps this patent is for you. It describes being able to chat with other Amazon users about products on the site in a sort-of group discussion. One example given in the patent's documentation is for the "Harry Potter" series: One person says "The Goblet of Fire" is the best book, and then someone chimes in to say they actually think "The Sorcerer's Stone" is better, and others agree, leading someone to purchase that book. This seems like a neat idea for comparison shopping, though anyone who would want to start a seven-book series on any book other than the first one has issues even a chat function can't fix.

Following a picture for package deliveries

Sometimes, a person's front door isn't especially obvious. I mean, if I saw this and was supposed to deliver a package to that address, I'd probably just give up. Amazon's new patent would help delivery workers figure out where to drop a package off: The first time someone delivers a package to an address, they snap a photo of the place, and future delivery workers could consult the image to see if they're actually in the right spot. It would presumably also help Amazon and its delivery people prove they delivered a package where they said they would, when they said they did.


A wearable ring computer

Apple received a patent a few weeks ago for a ring-shaped wearable to control a VR system, but this week's patent takes things much further. Apparently someone on Apple's storied design team thought it would be worth trying to jam the functionality of an Apple Watch onto an even smaller device, worn on a finger instead of the wrist. I already have a tough time reading things on the relatively small display of my Apple Watch — let alone accurately tapping on the screen — so I can't imagine reading anything on a screen like this:

Tintable windows

This patent has one of my favorite opening lines to date: "It is desirable to provide vehicles and buildings with windows." If you agree with this highly controversial statement, then read on. Apple's patent outlines an electronic system that would allow you to dynamically change how tinted your windows are. This could be useful for that extremely annoying part of the day right before dusk when the sun seems to be directly in your eyes wherever you're driving, and then it's dark before you know it. Changing up the tinting could be super helpful, especially if you're like me and can never remember where you put your sunglasses.


A sliding scale of emotion

A few years back, Facebook introduced the ability to react to posts with something other than the 👍 emoji, adding in a ❤️ and the cast of "Inside Out," but it seems that wasn't enough for Facebook. This new patent suggests a system for responding to any article posted on Facebook with a sliding scale of emotions. Instead of just seeing a happy, sad, amazed and angry emoji, you'd now see what appears to be the entire gamut of human emotion, from elated to depressed, and sort of blasé in the middle. I'm not sure why you'd want to react to something by telling the person who posted it that you're nonplussed, but to each his own. I'm blasé about it.

Battery-saving help

I'm sharing this one mainly because it has some of the wildest art I've ever seen in a patent. Most of the time, patents use generic clip-art of computers or phones or whatever they're trying to illustrate, or very crude line drawings of people. But this patent decided to dip into the public domain and drop in some drawings from Lewis Carroll's classic "Alice in Wonderland." The patent outlines a system for reducing the power consumption of an always-on social network app (like Facebook's Messenger app can be on Android devices). But overlaid on that scenario are the Mad Hatter, the March Hare, the Cheshire Cat and Alice, all of whom are apparently Facebook users.


An earpiece and stylus combo

This is an interesting idea for combining peripherals with a tablet — which just happens to look a lot like Microsoft's forthcoming Surface Duo. The patent describes a stylus that can be bent into a semicircle and then used as a charging dock for a wireless earpiece. When you want to use the stylus, you snap it straight, and you can draw on your tablet. I'm not sure what the market for single earpiece and stylus combos looks like, but it's a neat way to save space on the peripherals you'd want to carry along with your new Surface tablet.

Reminding you of the real world when you're in VR

If you're deep into some VR experience, you might forget that you're not actually on the side of a mountain or on an alien starship. Microsoft's patent explains a system that could use cameras or sensors on your headset to scan the room you're in, and overlay real objects onto whatever you're looking at to remind you to be careful. It would apparently also work for moving objects — like your dog running through the room — so there shouldn't be any surprises as you navigate through your virtual world. Just make sure to not get confused and try to shoot your dog when it comes into your view.

Get in touch with us: Share information securely with Protocol via encrypted Signal or WhatsApp message, at 415-214-4715 or through our anonymous SecureDrop.

Cutting down on phishing

A simple way for potential hackers to figure out if email addresses are real is to put them into the sign-on page for the email provider; if the site says the password is incorrect, the hacker will know that the email address is legit. Microsoft suggests a new solution: sign-on pages that don't make it obvious whether an account is real. The system might tell a person trying to log in for the first few attempts whether the email or password is incorrect (or just keep it vague and say one or both items are incorrect), but then lock down the site if the would-be hacker keeps trying to guess email addresses. And if you're not a hacker and you can't remember your own email address, do you really even need that email?


Why foundation models in AI need to be released responsibly

Foundation models like GPT-3 and DALL-E are changing AI forever. We urgently need to develop community norms that guarantee research access and help guide the future of AI responsibly.

Releasing new foundation models doesn’t have to be an all or nothing proposition.

Illustration: sorbetto/DigitalVision Vectors

Percy Liang is director of the Center for Research on Foundation Models, a faculty affiliate at the Stanford Institute for Human-Centered AI and an associate professor of Computer Science at Stanford University.

Humans are not very good at forecasting the future, especially when it comes to technology.

Keep Reading Show less
Percy Liang
Percy Liang is Director of the Center for Research on Foundation Models, a Faculty Affiliate at the Stanford Institute for Human-Centered AI, and an Associate Professor of Computer Science at Stanford University.

Every day, millions of us press the “order” button on our favorite coffee store's mobile application: Our chosen brew will be on the counter when we arrive. It’s a personalized, seamless experience that we have all come to expect. What we don’t know is what’s happening behind the scenes. The mobile application is sourcing data from a database that stores information about each customer and what their favorite coffee drinks are. It is also leveraging event-streaming data in real time to ensure the ingredients for your personal coffee are in supply at your local store.

Applications like this power our daily lives, and if they can’t access massive amounts of data stored in a database as well as stream data “in motion” instantaneously, you — and millions of customers — won’t have these in-the-moment experiences.

Keep Reading Show less
Jennifer Goforth Gregory
Jennifer Goforth Gregory has worked in the B2B technology industry for over 20 years. As a freelance writer she writes for top technology brands, including IBM, HPE, Adobe, AT&T, Verizon, Epson, Oracle, Intel and Square. She specializes in a wide range of technology, such as AI, IoT, cloud, cybersecurity, and CX. Jennifer also wrote a bestselling book The Freelance Content Marketing Writer to help other writers launch a high earning freelance business.

The West’s drought could bring about a data center reckoning

When it comes to water use, data centers are the tech industry’s secret water hogs — and they could soon come under increased scrutiny.

Lake Mead, North America's largest artificial reservoir, has dropped to about 1,052 feet above sea level, the lowest it's been since being filled in 1937.

Photo: Mario Tama/Getty Images

The West is parched, and getting more so by the day. Lake Mead — the country’s largest reservoir — is nearing “dead pool” levels, meaning it may soon be too low to flow downstream. The entirety of the Four Corners plus California is mired in megadrought.

Amid this desiccation, hundreds of the country’s data centers use vast amounts of water to hum along. Dozens cluster around major metro centers, including those with mandatory or voluntary water restrictions in place to curtail residential and agricultural use.

Keep Reading Show less
Lisa Martine Jenkins

Lisa Martine Jenkins is a senior reporter at Protocol covering climate. Lisa previously wrote for Morning Consult, Chemical Watch and the Associated Press. Lisa is currently based in Brooklyn, and is originally from the Bay Area. Find her on Twitter ( @l_m_j_) or reach out via email (ljenkins@protocol.com).


Indeed is hiring 4,000 workers despite industry layoffs

Indeed’s new CPO, Priscilla Koranteng, spoke to Protocol about her first 100 days in the role and the changing nature of HR.

"[Y]ou are serving the people. And everything that's happening around us in the world is … impacting their professional lives."

Image: Protocol

Priscilla Koranteng's plans are ambitious. Koranteng, who was appointed chief people officer of Indeed in June, has already enhanced the company’s abortion travel policies and reinforced its goal to hire 4,000 people in 2022.

She’s joined the HR tech company in a time when many other tech companies are enacting layoffs and cutbacks, but said she sees this precarious time as an opportunity for growth companies to really get ahead. Koranteng, who comes from an HR and diversity VP role at Kellogg, is working on embedding her hybrid set of expertise in her new role at Indeed.

Keep Reading Show less
Amber Burton

Amber Burton (@amberbburton) is a reporter at Protocol. Previously, she covered personal finance and diversity in business at The Wall Street Journal. She earned an M.S. in Strategic Communications from Columbia University and B.A. in English and Journalism from Wake Forest University. She lives in North Carolina.


New Jersey could become an ocean energy hub

A first-in-the-nation bill would support wave and tidal energy as a way to meet the Garden State's climate goals.

Technological challenges mean wave and tidal power remain generally more expensive than their other renewable counterparts. But government support could help spur more innovation that brings down cost.

Photo: Jeremy Bishop via Unsplash

Move over, solar and wind. There’s a new kid on the renewable energy block: waves and tides.

Harnessing the ocean’s power is still in its early stages, but the industry is poised for a big legislative boost, with the potential for real investment down the line.

Keep Reading Show less
Lisa Martine Jenkins

Lisa Martine Jenkins is a senior reporter at Protocol covering climate. Lisa previously wrote for Morning Consult, Chemical Watch and the Associated Press. Lisa is currently based in Brooklyn, and is originally from the Bay Area. Find her on Twitter ( @l_m_j_) or reach out via email (ljenkins@protocol.com).

Latest Stories