Apple wants to put a computer on your finger

Plus, book chat groups, bendable styluses and "Alice in Wonderland" in patents.

Apple Watch Series 5

Like this, but even smaller.

Photo: Apple

It's the weekend, which means it's again time to switch from your bad screen to your good screen. It also means a whole new slew of patents from the U.S.' biggest tech companies is here, and there were some truly zany things going on this week. Apple wants to make an Apple Watch for your finger; Google wants to cover your house in ads; Amazon wants us to argue about "Harry Potter"; Microsoft wants to keep you alive in VR; and Facebook put the characters from "Alice in Wonderland" in Messenger for some reason.

And remember: The big tech companies file all kinds of crazy patents for things, and though most never amount to anything, some end up defining the future.


Removing human interaction from your life

Google has been working on Duplex, its AI assistant that can call businesses and make reservations on behalf of a user, for a little while now — with mixed results. The company's patent from this week explains the system in more detail, and how the assistant could theoretically call every Chinese restaurant in your town to find out which has availability that evening. If it worked as envisioned, it would be a technical marvel that would almost certainly mean you would never have to talk to a maitre d' again, and also probably annoy every business in town.

Surrounded by ads

When our devices can talk to each other, they can perform useful tasks like turning on the lights, lowering the heat, or even switching channels on the TV. Now it's apparently (and inevitably) time for our interconnected devices to become digital billboards. In this patent, Google outlines a system where a user could be watching a show on one device — like a smart TV or phone — and when an ad displays, it could show related content, such as a shopping link or an instructional video, on other screens on your network. It'd be like Times Square in your living room, when all you wanted to do was catch up on "Ozark."

Robotic surgeries

Although Verily got out of Verb Surgical, its joint-venture with Johnson & Johnson exploring robotic surgeries, it's still pursuing patents around surgical bots. It was recently awarded one that describes how a robot could be used to dissect tissues, either for procedures like biopsies or to help out in surgeries. The system could use computer vision and rough instructions from a person on the areas they would like the robot to cut, presumably with greater accuracy than a human surgeon could. The robot could also image the tissue it's cutting, which could help doctors diagnose their patients. I hope in the future Verily's former sister company provides the robots, so after they perform a successful surgery, they can do a few backflips.


Robots that suck

In its quest to automate the entire retail process, one of Amazon's biggest sticking points is that not every object it sells comes in a nice square box. Humans are very good at being able to quickly understand how to pick something up, thanks to millennia of evolution. Robots, on the other hand, aren't very good at adapting. Teach them to pick up a box and they'll be able to do it forever, but if you then tell them to pick up a football, they'll struggle. Amazon has been trying for years to replace the humans who pack its boxes with robots. And a patent published this week suggests a breakthrough might be around the corner. It outlines a robotic arm with a suction system attached to the end that can form around uneven surfaces, kind of like picking something up with your mouth. Not that I've ever tried to do that.

Chatting through book recommendations

If you're after something a little deeper than the star-rating system Amazon currently uses, perhaps this patent is for you. It describes being able to chat with other Amazon users about products on the site in a sort-of group discussion. One example given in the patent's documentation is for the "Harry Potter" series: One person says "The Goblet of Fire" is the best book, and then someone chimes in to say they actually think "The Sorcerer's Stone" is better, and others agree, leading someone to purchase that book. This seems like a neat idea for comparison shopping, though anyone who would want to start a seven-book series on any book other than the first one has issues even a chat function can't fix.

Following a picture for package deliveries

Sometimes, a person's front door isn't especially obvious. I mean, if I saw this and was supposed to deliver a package to that address, I'd probably just give up. Amazon's new patent would help delivery workers figure out where to drop a package off: The first time someone delivers a package to an address, they snap a photo of the place, and future delivery workers could consult the image to see if they're actually in the right spot. It would presumably also help Amazon and its delivery people prove they delivered a package where they said they would, when they said they did.


A wearable ring computer

Apple received a patent a few weeks ago for a ring-shaped wearable to control a VR system, but this week's patent takes things much further. Apparently someone on Apple's storied design team thought it would be worth trying to jam the functionality of an Apple Watch onto an even smaller device, worn on a finger instead of the wrist. I already have a tough time reading things on the relatively small display of my Apple Watch — let alone accurately tapping on the screen — so I can't imagine reading anything on a screen like this:

Tintable windows

This patent has one of my favorite opening lines to date: "It is desirable to provide vehicles and buildings with windows." If you agree with this highly controversial statement, then read on. Apple's patent outlines an electronic system that would allow you to dynamically change how tinted your windows are. This could be useful for that extremely annoying part of the day right before dusk when the sun seems to be directly in your eyes wherever you're driving, and then it's dark before you know it. Changing up the tinting could be super helpful, especially if you're like me and can never remember where you put your sunglasses.


A sliding scale of emotion

A few years back, Facebook introduced the ability to react to posts with something other than the 👍 emoji, adding in a ❤️ and the cast of "Inside Out," but it seems that wasn't enough for Facebook. This new patent suggests a system for responding to any article posted on Facebook with a sliding scale of emotions. Instead of just seeing a happy, sad, amazed and angry emoji, you'd now see what appears to be the entire gamut of human emotion, from elated to depressed, and sort of blasé in the middle. I'm not sure why you'd want to react to something by telling the person who posted it that you're nonplussed, but to each his own. I'm blasé about it.

Battery-saving help

I'm sharing this one mainly because it has some of the wildest art I've ever seen in a patent. Most of the time, patents use generic clip-art of computers or phones or whatever they're trying to illustrate, or very crude line drawings of people. But this patent decided to dip into the public domain and drop in some drawings from Lewis Carroll's classic "Alice in Wonderland." The patent outlines a system for reducing the power consumption of an always-on social network app (like Facebook's Messenger app can be on Android devices). But overlaid on that scenario are the Mad Hatter, the March Hare, the Cheshire Cat and Alice, all of whom are apparently Facebook users.


An earpiece and stylus combo

This is an interesting idea for combining peripherals with a tablet — which just happens to look a lot like Microsoft's forthcoming Surface Duo. The patent describes a stylus that can be bent into a semicircle and then used as a charging dock for a wireless earpiece. When you want to use the stylus, you snap it straight, and you can draw on your tablet. I'm not sure what the market for single earpiece and stylus combos looks like, but it's a neat way to save space on the peripherals you'd want to carry along with your new Surface tablet.

Reminding you of the real world when you're in VR

If you're deep into some VR experience, you might forget that you're not actually on the side of a mountain or on an alien starship. Microsoft's patent explains a system that could use cameras or sensors on your headset to scan the room you're in, and overlay real objects onto whatever you're looking at to remind you to be careful. It would apparently also work for moving objects — like your dog running through the room — so there shouldn't be any surprises as you navigate through your virtual world. Just make sure to not get confused and try to shoot your dog when it comes into your view.

Get in touch with us: Share information securely with Protocol via encrypted Signal or WhatsApp message, at 415-214-4715 or through our anonymous SecureDrop.

Cutting down on phishing

A simple way for potential hackers to figure out if email addresses are real is to put them into the sign-on page for the email provider; if the site says the password is incorrect, the hacker will know that the email address is legit. Microsoft suggests a new solution: sign-on pages that don't make it obvious whether an account is real. The system might tell a person trying to log in for the first few attempts whether the email or password is incorrect (or just keep it vague and say one or both items are incorrect), but then lock down the site if the would-be hacker keeps trying to guess email addresses. And if you're not a hacker and you can't remember your own email address, do you really even need that email?


Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep ReadingShow less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep ReadingShow less
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep ReadingShow less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep ReadingShow less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.


Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep ReadingShow less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories