Power

Apple wants to connect your shirts and rugs to the internet

Plus blockchain-based supply chains, robot shelves, Amazon puzzles and other patents from Big Tech.

Apple wants to connect your shirts and rugs to the internet

Who needs a watch when you have a sleeve?

Image: Apple/USPTO

Happy Sunday! Grab some coffee, take a load off and enjoy the day with some patents from Big Tech.

This week saw a pretty wide range of ideas from the big companies in the U.S., but many of them seem to be focused on using digital assistants to make life a bit easier. Microsoft wants to help you remember where you put your keys; Google wants to remind you of how much you're spending on lunch; and Apple wants you to know if you've cracked your windshield. All things that could take a little load off of your mind.

And remember: The big tech companies file all kinds of crazy patents for things, and though most never amount to anything, some end up defining the future.

Alphabet

Getting insight out of your images

How hard is it to keep track of how much you've spent or where you've been in a given week? Considering I can't remember what I even had for breakfast yesterday, I'd say it can be quite hard. People are increasingly taking snaps of everything in their lives, and Google is interested in actually pulling key information out of those photos.

In this patent, you ask a virtual assistant how much you've spent over the week, and the assistant could pull photos of all the receipts you took that week, read the totals of all of them, and add them together. That could be super useful for people who have to do a lot of expenses, or are just extremely forgetful, like me.

Baby monitor

This isn't really new but an interesting ownership discovery. Last year, Verily partnered with Pampers to create a suite of baby-monitoring products, including a connected camera. In the release at the time, Verily said it designed the sensor and software technology stack, but it seems it also holds the actual design patent for the camera.

Amazon

Expandable robot-controlled shelves

Amazon has built some of the most complex product-storage and fulfillment warehouses in the world, but they generally take up a ton of space, existing in massive footprints in areas where land is cheap. But that isn't always the most effective way to get products to consumers in densely populated areas. Micro-fulfillment setups, often involving complex conveyor belts and robots, have started to take off recently, and it seems that Amazon is looking to join in the trend.

This patent outlines an expandable conveyor-belt storage system that can use robots to sort and pack their moving shelves. It could be a way for the company to get products closer to the people it's delivering to, in smaller spaces than it's usually occupied.

Solving puzzles to get discounts

Would you be more willing to buy something if you got a discount on it for solving a puzzle? That seems to be something Amazon is exploring in its latest patent. It outlines a function on a shopping site, or through voice assistants and texts, where you could win a percentage off the cost of an item you're searching for by solving a puzzle about the item or the store. It could be something like what shoes a celebrity is wearing in a photo, or what was the last thing you bought off the site. The idea would be to drive further loyalty to the company and, of course, sell some more stuff.

Apple

Detecting cracked windshields

It's super dangerous to drive around with a cracked windshield, but sometimes tiny cracks are difficult to notice. Apple's new patent — for a vehicle it's definitely maybe probably not potentially for sure working on — wants to fix that. A system built into the windshields and other windows on a car would be able to take electrical measurements of the surface of the glass to spot any deficiencies and then alert the driver to get it fixed. I wonder if Apple cars would also be made out of glass that definitely needs a protective case on it at all times to keep them safe.

Connected clothing and fabrics

Have you ever wished the inanimate objects around your home were more interactive? Apparently Apple has. The company's new patent outlines a way of adding electrical sensors to woven fabrics, allowing you to use them to control a computer. In some examples in the patent, the applications sound pretty familiar to Google's Jacquard project, although the patent suggests also being able to do things like use the connected fabric to control your computer's cursor, rather than just control the music on your phone.

But other implementations suggest adding the tech into "a cloth, rug, tapestry, upholstery or other fabric-based article"; I could see a future Apple rug that knows to turn on the lights when someone steps on it for the first time that day, or a couch with a dimmer switch built in. It's a brave new world where our furniture may one day need system updates.

Facebook

Turning pictures into stories

If you've ever uploaded a bunch of photos to Facebook from a holiday, you've probably left it up to your followers to figure out what you actually did on vacation, rather than write a description for your whole trip. No one has time for that. But a new patent from Facebook wants to help you out, with a system that could create a narrative out of the shots you upload. Conversely, it could also help select photos, based on your tastes (from what you've liked and shared on the social network), for a post that you've drafted. Perhaps it won't be long until all our creativity is outsourced to algorithms.

Microsoft

Voice assistants remembering things you've forgotten

We love to say that voice assistants are always listening to us, but sometimes that can actually be pretty useful. Microsoft's patent suggests using voice assistants' always-on function to track things around your house that you might've forgotten. How many times have you misplaced your keys or forgotten whether you locked the front door? Microsoft suggests training an algorithm on the sounds of common household objects and events — like dropping the keys on the counter or locking a door — and then using those sounds' proximity to smart speakers to log them as events, which a user could then ask about. Alexa may soon be able to tell you where you last left your keys, or Google could tell you whether you left the oven on, solving some of the anxieties everyone tends to face in daily life.

Blockchain-based IoT devices for supply chains

This is one of the rare enterprise uses of blockchain technology that sounds promising. Microsoft's patent envisions IoT devices to track products' movements along a supply chain and ensure they're meeting the standards agreed upon by the companies involved. The patent lays out the example of an IoT device that's loaded with an immutable smart contract agreed upon by the shipper and the customer that states the shipper's freezer container can't get warmer than a certain temperature. The second the temperature threshold is breached, the contract is breached, alerting everyone involved. This would ensure that produce being shipped is actually being done so safely — and that all the chicken I buy (which is a lot) won't kill me.

Turning a regular pen into a digital one

If you've ever used a computer stylus, you've probably noticed that it can't really replicate the feeling of actually drawing on paper with a pen. Microsoft's new patent doesn't want to: Instead of trying to replicate it, it suggests adding a digital element to a physical pen, using a connected cartridge that could be inserted into a regular pen. You'd be able to write or draw like normal, but have what you're doing be captured digitally. It's the best of both worlds.

Fintech

Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep ReadingShow less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep ReadingShow less
FTA
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.
Enterprise

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep ReadingShow less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep ReadingShow less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.

Enterprise

Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep ReadingShow less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories
Bulletins