Google wants to help you get a life

Digital car windows, curved AR glasses, automatic presentations and other patents from Big Tech.

Google wants to help you get a life

A new patent from Google offers a few suggestions.

Image: USPTO

Another week has come to pass, meaning it's time again for Big Tech patents! You've hopefully been busy reading all the new Manual Series stories that have come out this week and are now looking forward to hearing what comes after what comes next. Google wants to get rid of your double-chin selfie videos and find things for you as you sit bored at home; Apple wants to bring translucent displays to car windows; and Microsoft is exploring how much you can stress out a virtual assistant.

And remember: The big tech companies file all kinds of crazy patents for things, and though most never amount to anything, some end up defining the future.


Making selfies look better

Perhaps even before our lives were dominated by video calls, you might've noticed when someone just couldn't figure out where to place their camera. Generally, anything below eye height is going to lead to some unflattering angles, but if you're also on a phone, holding your device up that long can get tiring. Google is apparently trying to solve this with AR: According to this patent, it's looking into using the depth sensors found on the front of many smartphones to re-create your face in video calls at a more flattering angle, to reduce what the pattern calls "the big nose effect." I'm here for this concept, but also Google's depiction of what it's trying to eliminate:

Jamming more ads into Maps

Google Maps has become increasingly beset with ads in recent years, with promoted pins and locations on various instances of Maps. But this patent, which determines how Google goes about valuing ads in Google Maps — it, shockingly, has a lot to do with location — shows that the company might be looking at turning every part of the world into a digital version of Times Square, by displaying ads in-between the streets on a map. Hopefully it doesn't feel the need to run ads in all these potential slots at once, as that might make it rather difficult to navigate:

Outsourcing having a life to AI

It's tough to do things, I know. Many days, even before the pandemic, I was content to just sit on the couch all day watching TV and ordering takeout. But Google is apparently looking into outsourcing to a virtual assistant the task of making sure you actually get your butt off the sofa. The patent outlines an assistant that could suggest things to do, as well as where and when to do them, based on the user's preferences. It could also suggest things to do that your friends or other users have enjoyed doing. Some of the suggestions aren't exactly things I'd consider a hobby, though: choosing "fight off a cold" as an activity is a really odd way to want to pass the time.


Searching using loyalty programs

When you search for things online, you're generally only shown the prices for things that everyone sees. But if you're a member of a loyalty program, you might often get discounts or other benefits that could make some products cheaper or more attractive. Amazon's patent outlines a search engine that can store which loyalty programs you're a part of, and show any deals associated with that membership that businesses might be running. This could be useful for finding deals at partners of loyalty programs that you might not be aware of, but if you're already loyal to one hotel or airline brand, you're probably going to search them first before doing a general search.

Indoor drones

Amazon has been making waves for years about using autonomous drones for delivering orders, but to date, it hasn't gotten much traction. It seems, according to this patent, to be turning its attention at least partly to a less-regulated bit of airspace: indoors. The patent explains how autonomous drones, fitted with cameras and sensors, could be used to inspect inventory stored in the bins in the company's massive, high-ceilinged warehouses.


Smart tinted windows

This feels like a concept you'd see in sci-fi films set in a future where people have time to kill in the back of a self-driving car. Instead of staring at their phones, the sunroof and windows tint black, and news programs or views of scenic landscapes would replace whatever dystopian cityscape the car is driving through. It seems that Apple is looking into turning this into a reality, by creating see-through glass panes embedded with LEDs and other light sources that could change the color of the glass and allow information to be displayed on it. Pair that with the AR maps it was working on from last week, and you could have a whole new way of looking at driving on your hands.


Curved-lens AR glasses

This feels a little bit like the walking-around version to Apple's patent above. Most AR headsets use cameras to portray information on flat surfaces in front of your eyes. If you're like me and wear giant glasses that make you look like an owl, that might be fine, as your entire field of view is covered by lenses, but this patent explores adding AR to the periphery as well. The glasses in the patent have lenses that curve around the side of the frames so that they can overlay information on your peripheral view, which could make the experience of augmenting reality feel a little less jarring. That said, you would have to go out in public wearing something that looks like this:


Automatic presentation controls

If you've ever watched a presentation from a major tech company and wondered how they nailed the timing on slide changes so well … it's probably because they've rehearsed it a thousand times and have someone whose job it is just to press forward on the slide at the right time. But if you don't have that luxury at your disposal, you might find the ideas in this patent helpful. Microsoft is exploring presentation software that would be able to listen for cues in your speech to detect that you've gotten to the end of one slide, and move you automatically on to the next. It also suggests doing a training run, where the user runs through their presentation, manually clicking where they want to change slides, and the system would record that and do it automatically when they go to present. I'm not sure about having to have something listen to me at all times to get this to work, but it'd make presentations a lot less awkward than the "please can you click to the next slide, no, not the last slide, the next one" that often happens.

Getting angry at virtual assistants to get results

Stressing other people out when you're in charge is a very easy, albeit not very amenable, way to get stuff done. If you're having a conversation with someone and they stress to you, "I need you to get this back to me by end of day," and you know that they are ultimately the person who could end your employment, you're very likely going to get it back to them soon, unless you don't want to work there anymore. It's a lot harder to convey emotion and stress like that to a digital assistant, but this patent is exploring being able to understand human intonation and emotion in requests, such as a user stressing that they need to get a meeting scheduled with someone by the end of the week, which the AI would interpret as it being an urgent meeting when looking for time to schedule. Hopefully when the robot uprising comes, they'll not be too annoyed at us taking them for granted as digital PAs.


Why foundation models in AI need to be released responsibly

Foundation models like GPT-3 and DALL-E are changing AI forever. We urgently need to develop community norms that guarantee research access and help guide the future of AI responsibly.

Releasing new foundation models doesn’t have to be an all or nothing proposition.

Illustration: sorbetto/DigitalVision Vectors

Percy Liang is director of the Center for Research on Foundation Models, a faculty affiliate at the Stanford Institute for Human-Centered AI and an associate professor of Computer Science at Stanford University.

Humans are not very good at forecasting the future, especially when it comes to technology.

Keep Reading Show less
Percy Liang
Percy Liang is Director of the Center for Research on Foundation Models, a Faculty Affiliate at the Stanford Institute for Human-Centered AI, and an Associate Professor of Computer Science at Stanford University.

Every day, millions of us press the “order” button on our favorite coffee store's mobile application: Our chosen brew will be on the counter when we arrive. It’s a personalized, seamless experience that we have all come to expect. What we don’t know is what’s happening behind the scenes. The mobile application is sourcing data from a database that stores information about each customer and what their favorite coffee drinks are. It is also leveraging event-streaming data in real time to ensure the ingredients for your personal coffee are in supply at your local store.

Applications like this power our daily lives, and if they can’t access massive amounts of data stored in a database as well as stream data “in motion” instantaneously, you — and millions of customers — won’t have these in-the-moment experiences.

Keep Reading Show less
Jennifer Goforth Gregory
Jennifer Goforth Gregory has worked in the B2B technology industry for over 20 years. As a freelance writer she writes for top technology brands, including IBM, HPE, Adobe, AT&T, Verizon, Epson, Oracle, Intel and Square. She specializes in a wide range of technology, such as AI, IoT, cloud, cybersecurity, and CX. Jennifer also wrote a bestselling book The Freelance Content Marketing Writer to help other writers launch a high earning freelance business.

The West’s drought could bring about a data center reckoning

When it comes to water use, data centers are the tech industry’s secret water hogs — and they could soon come under increased scrutiny.

Lake Mead, North America's largest artificial reservoir, has dropped to about 1,052 feet above sea level, the lowest it's been since being filled in 1937.

Photo: Mario Tama/Getty Images

The West is parched, and getting more so by the day. Lake Mead — the country’s largest reservoir — is nearing “dead pool” levels, meaning it may soon be too low to flow downstream. The entirety of the Four Corners plus California is mired in megadrought.

Amid this desiccation, hundreds of the country’s data centers use vast amounts of water to hum along. Dozens cluster around major metro centers, including those with mandatory or voluntary water restrictions in place to curtail residential and agricultural use.

Keep Reading Show less
Lisa Martine Jenkins

Lisa Martine Jenkins is a senior reporter at Protocol covering climate. Lisa previously wrote for Morning Consult, Chemical Watch and the Associated Press. Lisa is currently based in Brooklyn, and is originally from the Bay Area. Find her on Twitter ( @l_m_j_) or reach out via email (ljenkins@protocol.com).


Indeed is hiring 4,000 workers despite industry layoffs

Indeed’s new CPO, Priscilla Koranteng, spoke to Protocol about her first 100 days in the role and the changing nature of HR.

"[Y]ou are serving the people. And everything that's happening around us in the world is … impacting their professional lives."

Image: Protocol

Priscilla Koranteng's plans are ambitious. Koranteng, who was appointed chief people officer of Indeed in June, has already enhanced the company’s abortion travel policies and reinforced its goal to hire 4,000 people in 2022.

She’s joined the HR tech company in a time when many other tech companies are enacting layoffs and cutbacks, but said she sees this precarious time as an opportunity for growth companies to really get ahead. Koranteng, who comes from an HR and diversity VP role at Kellogg, is working on embedding her hybrid set of expertise in her new role at Indeed.

Keep Reading Show less
Amber Burton

Amber Burton (@amberbburton) is a reporter at Protocol. Previously, she covered personal finance and diversity in business at The Wall Street Journal. She earned an M.S. in Strategic Communications from Columbia University and B.A. in English and Journalism from Wake Forest University. She lives in North Carolina.


New Jersey could become an ocean energy hub

A first-in-the-nation bill would support wave and tidal energy as a way to meet the Garden State's climate goals.

Technological challenges mean wave and tidal power remain generally more expensive than their other renewable counterparts. But government support could help spur more innovation that brings down cost.

Photo: Jeremy Bishop via Unsplash

Move over, solar and wind. There’s a new kid on the renewable energy block: waves and tides.

Harnessing the ocean’s power is still in its early stages, but the industry is poised for a big legislative boost, with the potential for real investment down the line.

Keep Reading Show less
Lisa Martine Jenkins

Lisa Martine Jenkins is a senior reporter at Protocol covering climate. Lisa previously wrote for Morning Consult, Chemical Watch and the Associated Press. Lisa is currently based in Brooklyn, and is originally from the Bay Area. Find her on Twitter ( @l_m_j_) or reach out via email (ljenkins@protocol.com).

Latest Stories