Power

Google wants to put a selfie ring on your finger

AR tagging, avoiding exes, connected prosthetics and other patents from Big Tech.

Google wants to put a selfie ring on your finger

All the single selfies? All the single selfies.

Image: USPTO/Google

It's been another long week in lockdown, but thankfully the U.S. Patent and Trademark Office has approved some truly fascinating patents this week to take our attention away from … everything else going on these days. Google is looking at building a selfie ring and fixing distracted driving, Facebook wants you to tag the real world with AR, and Microsoft really wants to help you avoid your problematic ex. I could definitely see these three patents going together well in the future.

And remember: The big tech companies file all kinds of crazy patents for things, and though most never amount to anything, some end up defining the future.

Alphabet

A wearable selfie ring

This sounds like something that could equally appear on "Black Mirror" and my own finger. Google has a new patent for a smart ring that doubles as a small selfie camera, because heaven forbid you're ever without a camera to capture every moment of your life. It even features a tiny button below the camera to capture the selfie, so you wouldn't need a second device to take the photo. The future rules.

Recognizing accents

Voice assistants have long struggled with languages spoken in accents that differ from those they were trained on, and it seems Google is trying to figure out how to solve this. It's building up a library of different accents, according to this patent, to classify and understand languages in various accents. Some of them are ones you'd expect, like a Southern drawl or a Boston accent, but then some are extremely specific, like Australian English with an Indonesian accent; some are just random, like "U.S. surfer" and Australian scuba diver. What exactly does an Aussie scuba diver sound like? Is this the setup to a joke I should know?

Blocking smartphones while driving

People are going to hate this, but honestly, it's a great idea. Phones are extremely distracting when you're driving, and even though we all know that, we still use them behind the wheel. This idea from Google would basically block content from being shown while in motion. Unlike other "do-not-disturb" driving modes that can be circumvented, this would be built into the phone's software to deny access to certain programs when you're traveling quickly, such as blocking access to YouTube videos while driving. But the question of how to determine whether the phone owner is driving is still a tricky one; to avoid compute-heavy processes like eye-tracking software, the patent suggests using an algorithm to determine whether the user's reaction time appears to suggest they're doing something else.

Amazon

Tracking people with magnetic tiles

Amazon's Go stores use a range of sensors to track you and the products you select as you move through the cashier-less experiences, and that system apparently includes magnets. This patent outlines a floor made up of a series of electromagnetic tiles that, when paired with some other sensor (a phone, perhaps?), can help track how many people are moving through a space, and where exactly they are. During a socially distant time, a system like this seems especially valuable.

Apple

Keeping wet clothes from messing with your Apple Watch

The latest Apple Watch software update has a nice little feature that recognizes when you're washing your hands and counts 20 seconds for you, helping you follow CDC safety guidelines. If you're like me, though, you don't want to roll up your sleeves before washing because if you had COVID-19 on your hands, you'll get it on your sleeves. You likely end up with wet cuffs and an Apple Watch that thinks you're touching all over the screen. This patent aims to fix that, by essentially guessing that when a large amount of input comes from the side of the watch closest to a sleeve, it should probably ignore it.

Facebook

Virtually tagging your friends in the real world

Remember the mid-2010s, when tagging people on Facebook was still a thing you did all the time? Facebook apparently wants to bring that experience back — for the real world. AR glasses aren't really a thing yet, but Facebook is preparing for that apparent eventuality with a patent that's exploring how we can digitally tag our friends and interests IRL. That could be something like tagging a friend to tell them to check out a piece of art at a museum they'd like, or to remind someone of a restaurant you've loved in their neighborhood. It's a neat concept that definitely won't turn into digital graffiti all over the physical world.

Giving a sense of touch back to amputees

This is a really interesting idea that seems to have been pioneered by researchers at Dartmouth College and acquired by Facebook. It's essentially a patent for a prosthetic device that can create haptic feedback for amputees. The device, as it's shown in the patent drawings, could be a robotic gripper arm attachment with sensors in the grippers that correlate to haptic actuators next to the wearer's skin. When pressure is applied to the grippers, the actuators would pulse or vibrate to give the wearer some sense of touch. Facebook is far from the only one researching this, but if technology like this proves to be successful, it could be a huge boon for the amputee community.

Microsoft

Making your own Clippy

Remember Clippy? He was that little paperclip icon on Word that tried to help you make better documents while really just being distracting and annoying. If you wanted to recreate that feeling for documents you manage for others, you might be in luck. Microsoft is exploring tools that would let users create document-specific assistants to help others who use them glean the contextual information they're after. Sadly, it's unclear if these assistants can be made to look like an anthropomorphic paperclip.

Searching for similar jobs

Sometimes hiring managers aren't always aligned on what a job title should be relative to the job's responsibilities. As a result, candidates may miss out on roles they'd be a good fit for if they use search terms that don't correlate with the posted listings. Microsoft is exploring deeper search criteria, like cross-referencing industries, skills required and length of experience, to help surface results that might be useful to a job seeker. Hopefully this will ensure no one ever confuses an Assistant Regional Manager with the Assistant to the Regional Manager.

Avoiding your ex — with technology

This patent has one of the most relatable titles I've ever seen: "Undesirable encounter avoidance." It also has a wonderful little story included in the copy about Alice and her friends Bart, Chris, Doug and Emily. Using social media and GPS, Alice can find out if she's near her friends (if they've all opted in), and if any of them are going to her favorite coffee shop. But when Alice breaks up with Bart, she might want to avoid the coffee shop if he's there. Microsoft is proposing using that same location tech to make sure Alice and others can avoid awkward situations IRL. Finally, a fantastic use case for the digital panopticon Big Tech has built.

Fintech

Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep ReadingShow less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep ReadingShow less
FTA
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.
Enterprise

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep ReadingShow less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep ReadingShow less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.

Enterprise

Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep ReadingShow less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories
Bulletins