Power

Microsoft envisions chatbots that rap

Looking at the patents that big tech was awarded or filed this week is like glimpsing into the future they envisioned before the world went into crisis mode.

Cartoon robots rapping

Microsoft's patent application for a chatbot that could rap even includes sample lyrics. (Yes, these are robots, not chatbots, but aren't they extremely cute?)

Photo: Westend61/Getty Images

It's an extremely weird time in this world, so anything that still has a sense of normalcy about it is quietly comforting. And it seems COVID-19 won't stop the bureaucracy of the U.S. Patent and Trademark Office from publishing its weekly patents and patent applications, all of which were submitted long before the world was hit by this crisis.

This week we have ideas from Alphabet, Amazon, Apple, Facebook and Microsoft that range from the quaint (how robots corral themselves) to the futuristic (wearable computers made of … fluids). Time to dive in.


Get what matters in tech, in your inbox every morning. Sign up for Source Code.


Alphabet

Making your own Hitchcock movie

There's a very famous camera trick that Alfred Hitchcock popularized called the "dolly zoom" that plays with perspective while filming. Traditionally, it's required some expensive camera lenses and a camera dolly (little tracks to move a tripod along on), hence the name. But Google is apparently working on a way of using "light-field data" — information about the intensity and direction of light in a scene — to re-create the effect. Google acquired the IP of a light-field camera startup a few years back, so perhaps the company is getting ready to put some game-changing video technology into a future Pixel device. I can't wait to to remake "Vertigo."

Being a courteous robot driver

Plenty of cars have blind-spot sensors these days, which warn you if there's a car in your blind spot. But the only way to avoid being in someone else's blind spot is just to be a conscientious driver. When it comes to robotic cars, which lack a conscience, that bit is a little harder. Waymo has a patent this week to design self-driving car software to address this. It would project rectangular buffer zones on either side of every vehicle traveling in front of a Waymo car so that it would know not to drive in the blind spots of cars around it.

Amazon

Fire escape for robots

Every good workplace needs a fire escape plan, involving how to get people out of the building and where they should reconvene. But what about robots? A new patent from Amazon envisions a system for moving robots to a designated safe area in the event of a fire. It maps out areas of an Amazon warehouse the robots can and can't move to in a fire, and designate a safe space to convene, such as behind a fire-resistant door. It's unclear if one robot would get a little hat and safety vest to lead all the other robots to safety, though.

Apple

Flexible keyboards

Ever since the days of the Power Glove, I've longed for some sort of flexible, wearable computing device. It's highly unlikely that that's what Apple had in mind with this patent, but who knows. It outlines a system for a flexible, illuminated keyboard that could be incorporated into fabric. It's probably some sort of response to Google's Jacquard rather than a retro-futuristic gaming controller, but I can still dare to dream.

Shape-changing mice

Apple's old standard computer mouse is not the most ergonomic, and according to this patent, the company seems to have finally realized that one size does not fit all hands, either. Here, the company patents a mouse that can expand its width and height to better support different-size hands. Not the most exciting thing, but a smart way to still offer only one mouse, while accommodating more body types.

Typing in VR, in the real world

It feels like with every passing week, we're learning a little more about Apple's work on a mixed-reality headset. This week, Apple has a patent application for a head-mountable computer system that can recognize inputs made in the physical world. For example, you could be wearing the headset, which is projecting a virtual keyboard in front of you, and you could tap away on those nonexistent keys and have the headset recognize what you're typing. I imagine that'll feel only slightly more awkward than typing on an iPad screen already does.

Facebook

Interpreting your speech through your muscles

Facebook purchased CTRL-Labs last year, and is already reaping the patent benefits. A new patent from CTRL, that's now assigned to Facebook, outlines the company's rather ornate sensing system designed for "using neuromuscular information to improve speech recognition." This could prove useful for some future voice-based AI system Facebook is working on, or could be a stepping stone along the way to its goal of building a brain-computer interface. I can't wait until Facebook knows everything I'm thinking all the time. Maybe then the targeted ads will finally be accurate.

Flexible circuits made out of fluids instead of electronics

This is a pretty wild idea: Instead of using electronic transistors, what if you used ones that relied on fluids? It's not a new idea — the company Fluidigm has been working on it for decades now — but Facebook seems to be looking into using these flexible, fluid circuits for wearables, especially for VR applications where you don't really want bulky electronics to take you out of the experience of the world you're in. Maybe those fancy bodysuits from "Ready Player One" aren't too far off.

Microsoft

Rapping chatbots!

Microsoft hasn't had the best luck with bots in the past, so if it ever progresses with this idea, it'll be … interesting … to see how it's used. The patent application outlines a chatbot that can be taught to rhyme or come up with poems, and challenge the human it's chatting with to do the same. The application suggests text-based "rap battles." I have no idea who would want to re-create "8 Mile" with a chatbot (perhaps an extremely bored child who's been cooped up inside for weeks?), but I'll leave you with a truly amazing example rhyme from the patent — may it bring you a moment of distraction from the world:

"Here's a skill I had, that you didn't know";

"Rhymes with code just like falling snow";

"Rhyme with me, go toe to toe";

"Maybe you can match my glow."

Fintech

Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep Reading Show less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep Reading Show less
FTA
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.
Enterprise

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep Reading Show less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep Reading Show less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.

Enterprise

Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep Reading Show less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories
Bulletins