Power

Facebook wants to know how much money you have

Plus, Apple has patented the interior design of some potted plants next to a table; Microsoft plans to track workers through their office; Alphabet wants a folding device, too; and Amazon will sell the Platonic ideal of products.

An eyeball looking at a screen

This week, the big tech companies filed patents for new ways to surveil people and new ways for tech to be helpful.

Illustration: PM Images/Getty Images

The big tech companies file all kinds of crazy patents for things, and though most never amount to anything, others end up defining the future. Every week, we round up the most interesting to emerge from the U.S. Patent and Trademark Office's weekly drop of new patents, which it is still doing every Tuesday, and which, in these uncertain times, allows me to know what day it is at least once a week.

This week, the big tech companies filed patents for new ways to surveil people and new ways for tech to be helpful, from providing better job applications, smarter speaker assistants, or, you know, implantable brain-monitoring devices. Hopefully that last one is a few years out.

Alphabet

Foldable Google phone?

Making phones, tablets and computers with foldable displays is all the rage these days. This week, Google received a patent that's basically a twofer, outlining a hinge mechanism for a folding device and software to determine what state the phone is in (such as whether the display is folded open or closed). Google hasn't publicly said that it's working on a foldable Pixel phone or computer, but it started working on support for foldable devices in Android in late 2018. Perhaps soon Google will join the ranks of device-makers that haven't quite figured out how to make a folding screen work, but would still like to charge you a lot of money for the pleasure of owning one.

Upgrade your body

There are already implantable medical devices on the market that can be used to monitor your glucose levels or stimulate your heart, but what about to interact with your brain? It sounds like something ripped from a cyberpunk movie, but many organizations are looking into exactly this idea, from Elon Musk's Neuralink to Facebook. And it's something Verily has also been working on in the background. This patent outlines an implantable device that links up to "a neural interface comprising a plurality of electrical leads." The patent goes into few details over what the brain interface could be used for, beyond "monitoring," but I'm guessing it won't be to store illegal hard drives or jack into a computer simulation, or anything else Keanu Reeves may have tried in the '90s.

Fixing your mistakes for you

If you've ever applied to a bunch of similar jobs or sent the same email to a lot of individual people, you've almost certainly had that mortifying moment when you realize you forgot to change who the email was addressed to, and your stomach drops when you see that you've emailed Sheila and called her Jeff. Google's new patent outlines a copy-paste system that recognizes the context in which text is being pasted. It could swap out names based on the email addresses and other cues.

Amazon

Computer-generated ideal products

Amazon's new patent sounds like it's working on using computers to create the Platonic ideal of the products it sells. The system it outlines suggests taking images of several of the items it sells within a given category, and merging them together to create one generic image that represents that category. This could be marginally useful for brands listing on Amazon, I guess? If you sell shoes and you're not Nike, you'd probably be slightly miffed if a retailer's website puts a picture of Nikes up to represent the "shoe" part of their site. But I could also see it being super confusing for customers who actually want to buy that amalgam of every shoe design Amazon sells. Perhaps that's a future product line for AmazonBasics.

Apple

Speaker zones

Say your kids are on the couch trying to watch TV while you're at the table in the same room trying to watch something on your laptop. It's virtually impossible, as the sound will be clashing, unless you pop in some headphones. Apple's new patent imagines a helpful scenario to keep the kids happy if you've forgotten your headphones: connected speakers that can blast different audio streams to different parts of a room. It's similar to how HomePod speakers can be connected to form audio zones in a house, but in the patent, each unit has speakers pointing in every direction, allowing some of them to fire one type of audio in one direction and another in the other. It's not clear how insane this would sound if you were standing directly in the middle of where the two zones met, but I'm guessing pretty insane.

Potted plants?

Apple is meticulous about its brand image, and that means trying to manage every single aspect of what it does. That includes, apparently, trademarking some potted trees next to some display tables for Apple stores. Apple's former head of retail, Angela Ahrendts, made it her mission to add a ton of greenery to Apple's stores (or "town squares," as she liked to call them), but it remains to be seen whether her successor, Deirdre O'Brien, will be as interested in green spaces.

Facebook

Measuring your lot in life

Facebook knows so much about the people that use its social networks, so perhaps this isn't that surprising a patent, but it's still a bit jarring. Facebook's new patent describes using data it has on people to guess their socioeconomic status. It suggests taking "biographic, demographic and other types of descriptive information, such as work experience, educational history, gender, hobbies or preferences, location and the like" from posts and information shared by a user to determine whether they're working class, middle class or upper class. And the end goal? To provide "sponsored content" for a "product or service to target users of the online system belonging to a particular socioeconomic group." I can't wait to find out which direct-to-consumer brands target me on Facebook based on my lot in life.

Microsoft

Tracking you through the office

This new patent sounds both deeply futuristic and invasive. Microsoft's patent outlines a system of sensors dotted around an office building, in lighting fixtures and other unassuming places, that are all meshed together and talking to each other. As a person passes by the sensors, they'll try to determine who they are, by comparing speech to stored recordings of the employee's voice, as well as things like "height, shoulder width, stride length, and/or facial features," according to the patent. Once the system figures out who is walking by, it can do things like preemptively turn on the lights when they walk into their office. Seems like a fair trade-off for constant biometric surveillance!

Making VR headsets a little less gross

It's far from the only thing keeping AR and VR headsets from hitting the mainstream, but have you ever thought about everyone who's ever sweated on a headset that's handed to you in a public setting? Microsoft's patent outlines how a headset like its HoloLens could wick sweat away from a wearer's forehead and the heat-generating system they're wearing in front of their eyes. The system has a "vapor-permeable spacer" between the device and the wearer that helps evaporate sweat and dissipate heat from the device. But I'd still probably wipe any headset down before putting it on.

"You don't want to work here — this job goes nowhere"

When you're interviewing for a new job, it's pretty common to ask what the prospects for growth at the company are. Microsoft's new patent would give people that information before even applying. It envisions a function on a job-seeking social network — Microsoft just happens to own one of those — that could show potential applicants what the likelihood for job growth is beyond the role they're applying for and what the attrition rate is for people with similar skills and backgrounds.

A real keyboard for your touchscreen device

All-screen laptop-shaped devices are apparently the future, whether we want them or not. Lenovo, Apple and Microsoft itself (which was conveniently awarded a patent on the topic this week!) are all in various stages of thinking about devices that don't have physical keyboards. Microsoft is thinking of way to have and not have a keyboard all at once: a physical keyboard that flips out from underneath the bottom of its folding tablet. It's like when Ryan Seacrest invested in that case company that turned your iPhone into a BlackBerry. Eventually, people do new things because they're easier overall, or they just don't do them. Time will tell if all-screen laptops are truly where we're heading.
Fintech

Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep ReadingShow less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep ReadingShow less
FTA
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.
Enterprise

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep ReadingShow less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep ReadingShow less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.

Enterprise

Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep ReadingShow less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories
Bulletins