Microsoft wants to replace artists with AI

Better Zoom calls, simpler email attachments, smart iPhone cases and other patents from Big Tech.

Microsoft wants to replace artists with AI

Turning your stories into images.

Image: USPTO/Microsoft

Hello and welcome to 2021! The Big Tech patent roundup is back, after a short vacation and … all the things … that happened between the start of the year and now. It seems the tradition of tech companies filing weird and wonderful patents has carried into the new year; there are some real gems from the last few weeks. Microsoft is trying to outsource all creative endeavors to AI; Apple wants to make seat belts less annoying; and Amazon wants to cut down on some of the recyclable waste that its own success has inevitably created.

And remember: The big tech companies file all kinds of crazy patents for things, and though most never amount to anything, some end up defining the future.

Alphabet

Making Zoom meetings a little nicer

Even after nearly a year at home, some people have still not figured out the best way to set up their digital meetings. They're either too close to the camera or so far away they might as well not be there. Part of the problem lies in the cameras they have available, as many webcams are too wide-angled: No one needs to see what's 8 feet to either side of you on a Zoom call. But this recent Google patent might help; it involves the meeting platform being able to gauge how far you are from the camera (by measuring the proportions of your face) and zooming in on you when you're speaking, hopefully making everyone look a little more uniform. The patent also included this wonderful diagram to explain it, which appears to have been made in Microsoft Paint:

Amazon

Reusing Amazon boxes

Everyone is shopping online far more than ever before, meaning ever-more cardboard boxes are littering our homes and recycling facilities. Amazon's new patent aims to help rectify this by creating a system that allows customers to easily reuse boxes that products come in. It's trying to remove all the steps usually found in shipping — such as weighing your package, getting a price to ship and bringing the package to a shipping facility — and replacing them with software. You'd scan the box you have and what you're trying to send, and Amazon's app would recognize what it is and estimate how much it'll cost to ship. You then pack it up and a courier comes to retrieve it. Now your friends and loved ones will never be without their Bad Monkeys.



Choosing music based on BPM

If you're making a playlist to work out — or perhaps you're a spin class instructor looking for songs with specific tempos — this idea might be for you. Amazon's patent suggests creating a way to search music to download based on songs' beats per minute. If you want a mix of slow songs to cool down with and uptempo ones to rock out, this could be useful (and is similar to something Pandora offers today). Or if you want a playlist that includes the fastest music ever to help you write faster, this could help. Or maybe that's just me.

Apple

Auto-returning attachments

Have you ever been sent a PDF that you're supposed to download, print, sign, rescan and email back, and then you lost the file in your downloads, opened up an old version and had to hunt down for the right one before you sent it back? Maybe you're not as scatterbrained as me, but Apple's new idea for a system that allows you to just interact with an attachment that needs to be sent back to your correspondent without leaving the email program sounds like a dream. A better dream, though, would probably be to get rid of random attachments altogether.

Seat belts that move based on where you sit

If you've ever been the third person on a road trip and wanted to sit in the middle seat in the back, you've probably gotten stuck with a seatbelt that's a bit too small; the middle seat isn't quite as large as the other two. This new design from Apple would essentially recognize where you sit in the backseat and move the entire seat belt machinery along so that you would be comfortably strapped in wherever you're sitting. It would also automatically reveal the buckle, so you wouldn't have to spend time hunting for where it's gone. This all sounds like it would make losing out when someone calls "shotgun" a little more bearable.

Cases for your AirPods, stylus and iPhone

Apple hasn't been without Jony Ive for very long, but it seems it's going ham on truly zany design concepts in his absence. In this patent, Apple explores various ways to combine a holder for AirPods and a stylus into a folio-style case for an iPhone that could also charge your peripherals and potentially display messages on the exterior. If Apple could pull this off in a way that didn't lead to a giant lumpy mess in my pocket, I'd potentially be interested, but the drawings in the patent are … less than promising:

Facebook

Animating digital avatars with VR headsets

Facebook is still pushing hard to make interacting in VR the future of … interacting … and this patent might help things feel a bit more natural. It suggests using cameras mounted on a VR headset pointed back at you to map real human facial expressions onto your digital avatar. Most VR programs with avatars either have faces that don't move when you're speaking or they just flap their mouths wildly; a system like this could make talking to someone dressed as a wizard or an elf or whatever else they've chosen to represent themselves online feel at least a little more normal.

Microsoft

Cortana for your car

Microsoft is apparently looking into application-specific virtual assistants, such as one designed for use in a car. It's a Car-tana, if you will. The assistant would be designed to provide specific insights about driving and how you could be saving money. That would include things like preemptively letting you know when a part might need servicing, how many miles it's been since you last fueled up or that your electric car's charge is low and chargers are nearby. It could announce these things over the car's stereo system, allowing you to keep your eyes on the road.

Computer-generated songs

Who needs musicians? Microsoft's new patent seems to want to make them obsolete. It suggests a system that can take an input, like a picture or some text, and turn it into a song. It can identify elements in the input, like the sentiment of the words or aspects of the image (like if people are outside or in a crowd) and build a melody and lyrics off of that. Sadly, as this is just a written document, there are no examples of this concept's potential output, if Microsoft has even built something like this. But if it does prove to be possible, I've got the perfect robot to perform this system's songs.

Turning speech into images

Microsoft is really on the art-generating bandwagon this week. This patent outlines a similar idea to the last one, envisioning a system that can take what someone is saying and turn it into images. The system could even string together generated images into a sort-of picture book: You could narrate a day you've had to the AI, and it generates something like a series of Instagram Stories based on what you say to it. Though it'd probably just be easier to actually take photos of what happened, honestly.

The fast-growing paychecks of Big Tech’s biggest names

Tech giants had a huge pandemic, and their execs are getting paid.

TIm Cook received $82 million in stock awards on top of his $3 million salary as Apple's CEO.

Photo: Mario Tama/Getty Images

Tech leaders are making more than ever.

As tech giants thrive amid the pandemic, companies like Meta, Alphabet and Microsoft have continued to pay their leaders accordingly: Big Tech CEO pay is higher than ever. In the coming months, we’ll begin seeing a lot of companies release their executive compensation from the past year as fiscal 2022 begins.

Keep Reading Show less
Nat Rubio-Licht
Nat Rubio-Licht is a Los Angeles-based news writer at Protocol. They graduated from Syracuse University with a degree in newspaper and online journalism in May 2020. Prior to joining the team, they worked at the Los Angeles Business Journal as a technology and aerospace reporter.

COVID-19 accelerated what many CEOs and CTOs have struggled to do for the past decade: It forced organizations to be agile and adjust quickly to change. For all the talk about digital transformation over the past decade, when push came to shove, many organizations realized they had made far less progress than they thought.

Now with the genie of rapid change out of the bottle, we will never go back to accepting slow and steady progress from our organizations. To survive and thrive in times of disruption, you need to build a resilient, adaptable business with systems and processes that will keep you nimble for years to come. An essential part of business agility is responding to change by quickly developing new applications and adapting old ones. IT faces an unprecedented demand for new applications. According to IDC, by 2023, more than 500 million digital applications and services will be developed and deployed — the same number of apps that were developed in the last 40 years.[1]

Keep Reading Show less
Denise Broady, CMO, Appian
Denise oversees the Marketing and Communications organization where she is responsible for accelerating the marketing strategy and brand recognition across the globe. Denise has over 24+ years of experience as a change agent scaling businesses from startups, turnarounds and complex software companies. Prior to Appian, Denise worked at SAP, WorkForce Software, TopTier and Clarkston Group. She is also a two-time published author of “GRC for Dummies” and “Driven to Perform.” Denise holds a double degree in marketing and production and operations from Virginia Tech.

Hybrid work has some distinct advantages when it comes to onboarding.

Photo: LogMeIn

Jo Deal is the chief human resources officer at LogMeIn. She is responsible for leading global people strategy with a focus on attracting, developing and engaging talent.

The desire for change that sprung up during the pandemic resulted in the highest attrition levels in decades and a fierce war for talent playing out in the market. The Great Resignation forced managers to suddenly make hiring their top priority, and recruitment partners became everyone’s best friend as leaders scrambled to replace key roles within their teams.

Keep Reading Show less
Jo Deal
Jo Deal serves as LogMeIn’s Chief Human Resources Officer. She is responsible for leading global people strategy with a focus on attracting, developing and engaging world class talent by expanding LogMeIn’s reputation as one of tech’s most desirable career destinations, and by providing a collaborative learning environment where employees can grow their careers.
Boost 2

Can Matt Mullenweg save the internet?

He's turning Automattic into a different kind of tech giant. But can he take on the trillion-dollar walled gardens and give the internet back to the people?

Matt Mullenweg, CEO of Automattic and founder of WordPress, poses for Protocol at his home in Houston, Texas.
Photo: Arturo Olmos for Protocol

In the early days of the pandemic, Matt Mullenweg didn't move to a compound in Hawaii, bug out to a bunker in New Zealand or head to Miami and start shilling for crypto. No, in the early days of the pandemic, Mullenweg bought an RV. He drove it all over the country, bouncing between Houston and San Francisco and Jackson Hole with plenty of stops in national parks. In between, he started doing some tinkering.

The tinkering is a part-time gig: Most of Mullenweg’s time is spent as CEO of Automattic, one of the web’s largest platforms. It’s best known as the company that runs WordPress.com, the hosted version of the blogging platform that powers about 43% of the websites on the internet. Since WordPress is open-source software, no company technically owns it, but Automattic provides tools and services and oversees most of the WordPress-powered internet. It’s also the owner of the booming ecommerce platform WooCommerce, Day One, the analytics tool Parse.ly and the podcast app Pocket Casts. Oh, and Tumblr. And Simplenote. And many others. That makes Mullenweg one of the most powerful CEOs in tech, and one of the most important voices in the debate over the future of the internet.

Keep Reading Show less
David Pierce

David Pierce ( @pierce) is Protocol's editorial director. Prior to joining Protocol, he was a columnist at The Wall Street Journal, a senior writer with Wired, and deputy editor at The Verge. He owns all the phones.

Entertainment

Peloton’s terrible, horrible, no good, very bad year

2022 just started, and Peloton has already halted bike production and is talking about mass layoffs. How did the pandemic darling get here?

How did Peloton go from pandemic star to sinking ship? One answer is the classic problem of supply and demand.

Image: Peloton; Protocol

It’s been a hell of a ride for Peloton. The headlines have been practically nonstop, from 2019’s cringey wife ad to 2021’s series of unfortunate “Sex and The City” events. But in 2020, Peloton could do no wrong. The at-home fitness company saw a 172% spike in sales over the course of that year, buoyed by the pandemic forcing wealthy gym-goers to stay home.

But nothing is ever easy or certain when it comes to Peloton. In the past week, Business Insider reported that Peloton is considering laying off 41% of its sales and marketing staff and closing down stores. CNBC learned that the company has hired McKinsey & Co. to help cut costs. And yesterday, CNBC reported that Peloton is temporarily halting production of its bikes. Peloton shares promptly plunged 24%.

Keep Reading Show less
Lizzy Lawrence

Lizzy Lawrence ( @LizzyLaw_) is a reporter at Protocol, covering tools and productivity in the workplace. She's a recent graduate of the University of Michigan, where she studied sociology and international studies. She served as editor in chief of The Michigan Daily, her school's independent newspaper. She's based in D.C., and can be reached at llawrence@protocol.com.

Entertainment

Netflix looks to expand gaming with major IP deals, Fortnite-like updates

Remarks made to investors and recent job postings hint at big ambitions for Netflix’s nascent gaming efforts.

Netflix may be taking some cues from games like Fortnite and Apex: Legends for its own video game initiative.

Photo: Cameron Venti/Unsplash

Two months after launching mobile games to all of its members, Netflix is looking to double down on gaming: The company told investors Thursday that it wants to expand its portfolio of games “across both casual and core gaming genres.” Recent job offers suggest that this could include both live services games as well as an expansion to PC and console gaming, and the company's COO hinted at major licensing deals ahead.

Keep Reading Show less
Janko Roettgers

Janko Roettgers (@jank0) is a senior reporter at Protocol, reporting on the shifting power dynamics between tech, media, and entertainment, including the impact of new technologies. Previously, Janko was Variety's first-ever technology writer in San Francisco, where he covered big tech and emerging technologies. He has reported for Gigaom, Frankfurter Rundschau, Berliner Zeitung, and ORF, among others. He has written three books on consumer cord-cutting and online music and co-edited an anthology on internet subcultures. He lives with his family in Oakland.

Latest Stories
Bulletins