Enterprise

It’s possible to save money on cloud computing, but it will cost you

SaaS companies are helping lower cloud subscription costs, as long as you subscribe to their services.

A cloud raining money.

Although it might seem counterintuitive, the best way to manage cloud spending could be spending money on spending control tools.

Illustration: Christopher T. Fong/Protocol

Click banner image for more Subscription Week 2022 coverage

The rise of the cloud made businesses faster, quicker and more agile. But it created a new problem: Usage-based billing models at cloud providers like Amazon AWS, Microsoft Azure and Google Cloud Platform have made it easier than ever for enterprises to lose control of computing costs.

There’s an underlying assumption that moving from on-premises servers to the cloud will help companies save money, said German Bertot, vice president and general manager of IT asset management at ServiceNow. But that’s not always the case. “The promise is there, and it is great. But companies are having a hard time realizing those savings,” he said.

“People are very surprised at how much money cloud computing is costing [them] over traditional computing,” said David Linthicum, Deloitte’s cloud strategy leader. While some of that is just the price of access to computing power, the majority of it is due to inefficiently managing spending, he said.

That’s why SaaS companies like Flexera, Apptio and ServiceNow are helping companies lower their cloud subscription costs — as long as you subscribe to their services, which, of course, aren’t free.

Out-of-control spending

The reason cloud costs can balloon so quickly is that managing expenses associated with compute power is a lot more complicated in the cloud than it was when companies bought and managed their own servers.

With data centers, it was common for CIOs to only purchase new technology every few years or so, said Flexera Senior Director Brian Adler. In response, IT employees would ask for as many resources as they could get, especially because most companies provisioned more computing power than they needed at the time. “But that was the way to do it; that was the behavior that we had because I was hoping I would grow into it,” said Adler.

Because it took such a long time to purchase and deploy infrastructure resources when operating on-premises data centers, this was fairly common behavior, said Forrester Senior Analyst Tracy Woo. The difference with the cloud is that provisioning “is something that you can demand and get online within minutes.”

However, when many customers first moved from on-premises operations to the cloud, they often brought the old data center mentality along with them. Instead of scaling up resources as needed, for example, many companies still feel the need to over-provision up-front. But with the cloud, “I don't buy the peak, I can rent the peak. So that's a new behavior that folks need to learn,” said Adler.

At other times, because there was no reason to turn off applications in data centers, customers would leave virtual machines in the cloud running. In data centers “it didn't matter if I turned off my virtual machine, the physical host was still going to run and chew up money; there was no benefit,” said Adler. But in the cloud, if you leave things running, you have to pay.

The other aspect that makes managing cloud costs difficult is that IT spending isn’t as centralized as it used to be.

For one, the ease of getting started on the cloud means it’s a lot easier to subscribe, deploy and then rack up large bills. “You don't need to get a purchase order out to your hardware provider, bring them in, pay for it up-front, get the hardware into your data center, install it and so on,” said Bertot. In fact, nearly any employee with a corporate credit card can sign up for a SaaS application and pay for a service.

The fact that most cloud providers bill based on usage also means that it's fairly easy to drive up costs if companies aren’t paying attention. Even gaining visibility into where spending is coming from can be a challenge, because a company could have hundreds of engineers using resources, but only get one bill. And those bills are so complicated that no one could look at all that data and determine if they’re being overcharged, said Adler, who has seen Flexera customers with 12 million rows of information in a single monthly bill.

That’s why software is absolutely required to truly understand cloud spend at the enterprise level, said Apptio vice president Eugene Khvostov. “By day two of the month, you're getting so much data that you can't possibly run it through without any software,” he said. “So you have to either build or buy specialized software.”

Spending to save

Although it might seem counterintuitive, the best way to manage cloud spending could be spending money on spending-control tools. That’s why the major cloud providers AWS, Azure and Google as well as SaaS companies like Flexera, Apptio and ServiceNow all offer services to help companies cut their cloud costs.

Although many of these services require purchasing yet another subscription, according to industry practitioners and analysts, the savings can be massive.

How do third-party software providers like Flexera, Apptio or ServiceNow actually help lower cloud costs? There are many different tactics, from lowering subscription tiers based on usage to turning off machines when they’re not in use or reserving instances in advance.

On the SaaS application end, understanding which users are consuming licenses, and how much they’re using, can help determine which subscription tier to purchase or who to give licenses to. If a user is consuming a license but not using it, “are there ways for us to analyze the usage patterns and suggest a lower level subscription … and in the process achieve savings?” said Bertot.

Other times savings can come from rationalizing SaaS applications. “How many different communications platforms do I have? Do I have Zoom and GoToMeeting and Teams and Citrix? What if I consolidate those?” said Khvostov.

At Deloitte, Linthicum has seen clients save as much as 200% on their cloud bills after using a spend management tool. Although that’s an outlier, “in many instances it’s going to be 30% to 50% savings,” minimum, he said. And “there’s always going to be some sort of savings 100% of the time in my experience.”

At Apptio, which owns the Cloudability spend management tool, Khvostov has seen similar results. “When we typically onboard a customer we find anywhere from 10% to 30% savings right away.”

Even incremental savings on cloud infrastructure costs could amount to significant amounts of money. While only a small number of companies spend a million per month on cloud services — Woo calls them power users — a lot of companies still spend hundreds of thousands per month, she said.

And because many of the cloud spend management tools are fairly affordable — typically, 1% to 3% of what customers spend on cloud services in a month — the return on investment far outweighs the cost of subscribing. “Generally you see an ROI for these within two weeks to three months,” said Woo.

Although the major cloud providers all offer tools that can help customers analyze their billing, they have limitations.

While the cloud service providers give visibility into how a company is spending with them, they can’t do the same across other cloud providers or with SaaS applications, for instance.

If a company analyzes its spending with just one cloud provider, that’s only going to create a silo, said Linthicum. “You're going to understand everything about a particular cloud provider, but not holistically,” he said.

When a company starts to do cloud at scale, for instance, it’s likely using a multicloud or hybrid approach. “So I might want to be handling visibility across multiple clouds and plop that in one portal or one control plane,” said Woo.

At ServiceNow, for example, the company's spend management tool connects directly into SaaS providers and also analyzes deployments that are still on-premises. “That's something that no cloud provider will ever be able to do,” said Bertot.

Cutting back

While customers who are new to the cloud will face many of these problems, over time they will get better at understanding how to manage their own spend. “Initially, it's usually a pretty big bang for the buck, and then it peters out over time,” said Adler.

But what does this mean for companies selling spend management tools? As customers become more adept at managing their own spend, could demand for these services wane? To some the answer is no, because cloud spend management requires ongoing monitoring.

In the cloud, cost governance is about the ability “to not only have observability so you can see where the costs are going, but have observability around the interdependencies, observability around how things are going to be billed moving forward, and do that across platforms,” said Linthicum.

Without spend management tools, companies would have to build their own internal processes and software to have that level of visibility over their cloud spend. While that’s possible, it’s a lot easier to buy a subscription.

This story was updated to correct German Bertot's title.

Fintech

Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep Reading Show less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep Reading Show less
FTA
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.
Enterprise

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep Reading Show less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep Reading Show less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.

Enterprise

Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep Reading Show less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories
Bulletins