Power

Amazon's working on a less-forgetful Alexa

Plus Nest thermostats for every house, inflatable Amazon packages and other patents from Big Tech.

Amazon's forgetful Alexa

Alexa tends to forget what it was up to. Amazon wants to fix that.

Image: Courtesy of USPTO

Some of the patents awarded to Big Tech this week seem to yearn for that long-ago time when we could convene for meetings in offices or would even be commuting to and from work. Hopefully it won't be long before everyone is able to enjoy the mundanities of normal life again, and these patents will make some of those things a little easier.

And remember: Companies file all kinds of crazy patents for things, and though most never amount to anything, some end up defining the future.

Alphabet

Nest thermostats for older homes

If you've ever used a Nest thermostat, you'll know they work quite well but require you to be relatively handy to install them. Many houses, especially older ones and those in Europe, don't rely on electronic thermostats, instead using bimetallic strips that react to temperature changes to turn on boilers. Good luck controlling those with your phone. Nest wants to fix that, with a patent that outlines a simpler-to-install thermostat. It would plug into the existing sensors in the wall, as well as a power socket. You'd also connect up a wireless receiver to the boiler, which would tell it to turn up or down the heat. It could be a simple way to bring old homes into the future.

Streaming apps

The idea of always-connected devices streaming always-updated apps to phones isn't necessarily new, but the logistics, connectivity and security have always been issues. Google seems to be thinking about a way to make them work as "ephemeral apps," where a user would download a shell for an app to their phone, but the content of the app actually lives on a cloud. This would mean the device would require far less storage space, which could make them cheaper to produce. According to the patent, it could also make it easier for IT managers to revoke or grant access to specific apps as employees need them.

Summarizing voice messages

If you ever call my voicemail, you'll hear my message … saying that I don't listen to voicemail. I tell people this is because it's easier for me to manage email messages, but it's also because I'm extremely lazy. It seems that I might not be the only one: This new patent from Google looks at how AI can be used to summarize voice messages. The system would automatically pull out the pertinent information, like when someone recites a phone number to call them on or a location to check out, and then the app you're using would allow you to call that number directly or pull that location up on a map. It'd be a huge boon for extremely busy lazy people like me.

Amazon

Tracking workers with depth-sensing cameras

This new patent seems designed to bring the tracking technology found in Amazon Go stores to the company's warehouses. It outlines a camera-tracking system that can determine who workers are by looking at their faces and clothes and monitor their progress through the warehouse floor, into break rooms and even to the bathroom (though it doesn't suggest following them in there). The cameras could also see what products workers are picking off shelves and where they're taking them, which would help Amazon keep better track of its inventory and warehouse efficiency. But it might also create an unsettling panopticon where Amazon employees have little place to hide from the all-seeing eye of their bosses.

Helping Alexa remember what you were talking about

If you've used third-party Alexa apps, you've probably had the problem where you ask Alexa quickly to do something else, and she "forgets" that you were using the other app. Fixing this problem, and giving Alexa a better memory, is something Amazon is apparently working on. This patent outlines a system where, for example, someone using a cooking app on Alexa could say, "Alexa start a timer for 5 minutes," and the assistant will do that. Right now, Alexa may then just stay silent after completing the task, but in the situation in the patent, it would remember to return on the cooking app the user was using before. Then again, if Amazon could just get its drone delivery program off the ground, maybe I could have ordered some takeout instead of having to rely on Alexa for cooking help.

Inflatable drone delivery packages

Speaking of which: Amazon is back with yet another way of trying to keep people — and the things they order — safe during drone deliveries. While the division may be struggling to deliver on Bezos' 2013 promise of superfast drone deliveries for Prime members, it's still working on ways of getting those products to them. Eventually. This new patent suggests creating delivery packages that can inflate as they drop to earth, presumably to avoid potentially injuring anyone or anything on the way down. It's like that famous James Bond gadget, but for the stick of deodorant you really needed right away.

Apple

Teaching Siri where you are in the house

Apple's ecosystem of smart home devices has gotten pretty robust in recent years, but any automation in those smart home systems has to be set up by the user. I have it rigged so that when my iPhone leaves my apartment, the Home app will turn off all the lights, but I haven't yet set one up to turn them all on when I get back. This new patent suggests a more intelligent version of the app that could suggest automations. It gives the example of someone who always uses the smartphone to close their garage door when they come up at night, and turn on the lights in their kitchen when they walk into the kitchen. In an ideal world, the smart home system would recognize the repeated actions and build an automation for the user. Then again, that user probably isn't going into work anymore, so nobody will be testing this one for a while.

Facebook

Amphibious robots

This new patent from Facebook envisions a zany wheeled robot device that could drive through water, if needed. The main innovation here is putting all the moving parts above the wheels, presumably keeping the entire drive mechanism above any water or other terrain the bot would be going through. But the craziest part of the patent is the last diagram, where two of these bots have been snapped together with a chair and some giant arms, so a person could scoot around and pick things up with their amphibious vehicle. The arms seem like an extension from the high-fiving robot Facebook patented a few weeks ago, but I'm not entirely sure what Facebook could be envisioning using these gangly robots for — maybe making sure we're all staying 6 feet apart?

Clubhouse, but make it Facebook

If you're in tech, you have probably heard of Clubhouse — and maybe even tried to invest in it. (For the uninitiated, it's a social network for short audio clips.) And in true Facebook fashion, the company seems to have patented its own spin on the idea, much like it's done for every other social network that's come along in recent years. The patent, in Facebook's defense, does offer a few ways in which its audio-only social network might actually be useful: for those who are visually impaired and those who may be shy to write long posts on Facebook but may be more willing to dictate them. But I'm not sure how many of those there are, given the treatises I've seen all over Facebook..

Microsoft

Using mobile devices on a connected whiteboard

Collaboration software can get a bit overwhelming, with people drawing over other people and everyone talking over each other. Microsoft's new patent is aimed at tying a person's identity to what they're sharing on a connected whiteboard or computer display. In the system, a user's personal phone would connect over Wi-Fi or Bluetooth to the computer powering the display, and a camera would track their motion relative to the display. This would allow people to show up to a meeting room, and the system would automatically know who is who. The cameras would also be able to tell if a user passed their device to someone else to show them something: If that second person started writing something for the big display, it would have their name attached to it. This may make collaboration software a little easier to use, but that seems like a problem for a far away time when we're all back in offices having meetings together. Remember conference room meetings? I actually miss them now.

Fintech

Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep Reading Show less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep Reading Show less
FTA
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.
Enterprise

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep Reading Show less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep Reading Show less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.

Enterprise

Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep Reading Show less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories
Bulletins