Cloud spending is hard to control. Cloud providers only do so much to help.

Customers must take initiative and use third-party software to supplement cloud vendors’ tools to optimize their cloud usage and spending.

Clouds with an obscured price

Cloud computing isn't just a rental server market; it's an entirely new way of building and maintaining applications.

Image: Christopher T. Fong/Protocol

Click banner image for more Subscription Week 2022 coverage

As cloud computing has become mainstream, gaining visibility into cloud costs and controlling them has become a perennial issue for enterprises. And the cost management tools offered by the cloud providers don’t get the job done.

Cloud costs continue to grow, and the amount of wasteful spending remains high, according to the Flexera 2022 State of the Cloud Report survey released in March. For the sixth straight year, optimizing their existing cloud use to realize cost savings — sometimes known as FinOps — was the No. 1 cloud priority this year for enterprise technical and business professionals. Better financial reporting on cloud costs also was a top initiative.

FinOps and this whole optimization and cost management are a critical part of the cloud operating model that customers have to put in when they're moving into the cloud estates,” said Chris Wegmann, managing director of Accenture’s AWS business group technology and practice. “[It’s] usually a function that gets skipped or missed or is not invested in as much.”

Deploying FinOps encourages data-driven management of cloud spending while simultaneously increasing efficiency and typically reduces cloud spending by as much as 20% to 30%, according to Accenture.

While cloud vendors provide some tools and support through technical account managers, customers must play a very active role, according to Wegmann. That includes knowing what their workloads need and making the necessary changes to optimize them, or risk paying more than they should.

“It is a shared responsibility, because … AWS can't make those changes on your behalf,” Wegmann said. “A lot of customers, in their on-premises environments, don't have that visibility, so they don't know where the spend is. But that's a big advantage in cloud.”

It’s all about data

The cloud providers offer basic cost-management services, but they typically must be augmented by third-party software and require cloud users to do some of the heavy lifting.

“Data is absolutely critical for cloud cost management, optimization, and that usually comes down to tagging,” Wegmann said. “That means you tag every piece of your cloud estate and then [make] sure that data model brings that all together. The tools themselves don't automatically create that data model or that mapping, and it's something that has to be done.”

AWS’ cloud cost management product suite includes AWS Cost Explorer to help customers visualize and manage their AWS costs and usage across all accounts; AWS Budgets to improve planning and cost control with budgeting and forecasting; and AWS Cost Anomaly Detection, a machine-learning model that learns customers’ historic spending patterns to detect one-time cost spikes and continuous cost increases. AWS Trusted Advisor inspects a customer’s AWS infrastructure and provides best-practice recommendations when there are opportunities to save money and optimize system availability, performance and security.

If you know what kind of computing performance your application requires, AWS has more than 475 instance types that customers can choose from to give them the best price-performance scenario, noted Chris Grusz, AWS’ director of Business Development, AWS Marketplace, Service Catalog and Control Tower.

“We have over 15 different database types … so you can pick the exact database that is going to suit what you're actually looking for and then run that on the exact instance type that you need,” Grusz said. “And then, of course, we're always looking to reduce that price wherever we can. [AWS] Marketplace also integrates into a number of our partner solutions, so that if a customer wants to view third-party spend for SaaS applications alongside their AWS consumption, we also have ways to feed into a lot of the popular cost-management products that are on the market.”

Accenture itself has a very large AWS presence that it’s constantly looking to optimize, and it employs the same internal tool that it uses with customers — the Accenture myNav platform — to optimize its cloud architecture, track and manage consumption and adjust spending accordingly, according to Wegmann.

“We have tens of millions of lines of billing data that come in; that means tens of millions of different services running,” Wegmann said. “We aggregate that and bring that to 1,000 or so different teams. Through that, we're constantly looking at optimization, ways to save money, turn stuff off when it's not being used, move from expensive instance types to lower cost. Sometimes it's cheaper storage or just changing … to more serverless, which is usually cheaper than having servers just sit around to process things.”

Accenture and almost all its AWS customers use a combination of native AWS and third-party tools such as CloudHealth by VMware or Cloudability to help monitor and control their cloud costs, as there’s not a single tool that can do it all, Wegmann said.

“Unfortunately, it takes two or three different tools, as well as what comes from Amazon, to do that,” Wegmann said. “We spend a lot of time with our customers, helping them make those decisions. Some of them do assessments or do free trials [of third-party software] or things like that to understand the capabilities and understand where it fits into their gaps.”

Help me help you

Helping customers control their cloud costs comes down to maintaining long-term relationships, according to Amit Zavery, general manager and head of platform for Google Cloud.

“If they’re successful, we're successful,” said Zavery, who manages Google Cloud’s commerce, billing and monetizer product team. “If they have budget constraints or budget requirements, or they want to have a future plan around their usage, we give them the controls. Otherwise it would be very difficult for them to scale and eventually use a lot more services.”

Zavery’s team builds the cost-control and cost-management capabilities provided to customers through the Google Cloud Console, which incorporates customers’ cloud usage and historical data.

“We've been trying to make sure that we provide as many tools and capabilities so that customers can look at their usage, manage the cost and optimize their capability usage as well so that they can have a better outcome using our products from the economic perspective,” Zavery said. “That data also is available to them to extract and put it in any kind of analysis tool. We have value advisers inside Google Cloud as well who can work very closely with customers.”

Google Cloud in March announced a series of price hikes for its infrastructure services that will take effect Oct. 1. It’s adding new data replication fees and network egress charges, and doubling prices for some services, such as coldline storage operations.

“We just brought our pricing somewhat to the industry standards versus anything else,” Zavery said. “We, of course, have been working very closely with the customers anytime we make any pricing changes, and we also try to provide insights to our customers into what their bills will look like.”

Microsoft declined to discuss how it helps customers monitor and control their cloud costs.

“Tracking cloud usage and associated costs should be a transparent process for any customer using the cloud,” a Microsoft spokesperson said in a statement. “That’s why Microsoft offers a suite of services, like Azure Cost Management and Billing, to ensure customers have the tools to accurately forecast and manage their cloud usage.”

“Intractable” problem

While the Big Three cloud providers say they help customers or make it easy for customers to monitor and control their costs, Corey Quinn begs to differ.

“All three of them will tell you they absolutely do, but they do not,” said Quinn, chief cloud economist for The Duckbill Group, which helps AWS customers manage their cloud costs. “They offer different tools, different points of visibility and the rest, but part of the problem is that they are distant enough from their customers that they do not fully understand the scope of the problem. And on some level, let's be clear, this is an intractable problem to have to solve.”

The cloud providers’ convoluted pricing structures effectively have become inscrutable, according to Quinn.

“For virtually every customer out there, the cloud bill every month is what the provider tells them it is, because who's going to have the energy even to dissect it, let alone argue,” he said.

The complexity of understanding and controlling cloud costs is driven by what an organization looks like — how large it is, how it interfaces across functions — and its technology stack.

“The more elastic and cloudy and higher-level services that a cloud provider has that you use, the less predictable the spend becomes,” Quinn said. “Yes, it becomes a lot more efficient, but also a hell of a lot harder to predict.”

Quinn usually starts customer cloud cost conversations with a series of questions: Is their cloud bill accurate? Is there a bunch of stuff that should be turned off? Are there misconfigurations in an engineering sense that relatively small changes would have a dramatic impact on? Do they have contract negotiations coming up?

“All the providers offer significant discounting for committed spend, but that commitment is measured in multiple years to a point where it's not just ‘predict your cloud bill next month,’ it's ‘predict what your spend is going to look like on what curve for the next half-a-decade,’” Quinn said. “That is an incredibly daunting task because you're about to sign on the dotted line, but it figures out what that's going to look like.”

“One thing that's often a canard is that people think, ‘Ah, I'm going to move to the cloud, because it'll save me money,’” Quinn said. “I've done the deep-dive TCO [total cost of ownership] analysis, and I am left with the conclusion that if you're doing this route to the cloud from your data center to save money, you're almost certainly wrong.”

After all, cloud computing isn't just a rental server market; it's an entirely new way of building and maintaining applications.

“You will not realize an appreciable cost savings for at least five years — arguably ever, depending on what you do,” Quinn said. “So the reason to do it instead is because of a capability story — it lets you move faster as a company.”


Judge Zia Faruqui is trying to teach you crypto, one ‘SNL’ reference at a time

His decisions on major cryptocurrency cases have quoted "The Big Lebowski," "SNL," and "Dr. Strangelove." That’s because he wants you — yes, you — to read them.

The ways Zia Faruqui (right) has weighed on cases that have come before him can give lawyers clues as to what legal frameworks will pass muster.

Photo: Carolyn Van Houten/The Washington Post via Getty Images

“Cryptocurrency and related software analytics tools are ‘The wave of the future, Dude. One hundred percent electronic.’”

That’s not a quote from "The Big Lebowski" — at least, not directly. It’s a quote from a Washington, D.C., district court memorandum opinion on the role cryptocurrency analytics tools can play in government investigations. The author is Magistrate Judge Zia Faruqui.

Keep ReadingShow less
Veronica Irwin

Veronica Irwin (@vronirwin) is a San Francisco-based reporter at Protocol covering fintech. Previously she was at the San Francisco Examiner, covering tech from a hyper-local angle. Before that, her byline was featured in SF Weekly, The Nation, Techworker, Ms. Magazine and The Frisc.

The financial technology transformation is driving competition, creating consumer choice, and shaping the future of finance. Hear from seven fintech leaders who are reshaping the future of finance, and join the inaugural Financial Technology Association Fintech Summit to learn more.

Keep ReadingShow less
The Financial Technology Association (FTA) represents industry leaders shaping the future of finance. We champion the power of technology-centered financial services and advocate for the modernization of financial regulation to support inclusion and responsible innovation.

AWS CEO: The cloud isn’t just about technology

As AWS preps for its annual re:Invent conference, Adam Selipsky talks product strategy, support for hybrid environments, and the value of the cloud in uncertain economic times.

Photo: Noah Berger/Getty Images for Amazon Web Services

AWS is gearing up for re:Invent, its annual cloud computing conference where announcements this year are expected to focus on its end-to-end data strategy and delivering new industry-specific services.

It will be the second re:Invent with CEO Adam Selipsky as leader of the industry’s largest cloud provider after his return last year to AWS from data visualization company Tableau Software.

Keep ReadingShow less
Donna Goodison

Donna Goodison (@dgoodison) is Protocol's senior reporter focusing on enterprise infrastructure technology, from the 'Big 3' cloud computing providers to data centers. She previously covered the public cloud at CRN after 15 years as a business reporter for the Boston Herald. Based in Massachusetts, she also has worked as a Boston Globe freelancer, business reporter at the Boston Business Journal and real estate reporter at Banker & Tradesman after toiling at weekly newspapers.

Image: Protocol

We launched Protocol in February 2020 to cover the evolving power center of tech. It is with deep sadness that just under three years later, we are winding down the publication.

As of today, we will not publish any more stories. All of our newsletters, apart from our flagship, Source Code, will no longer be sent. Source Code will be published and sent for the next few weeks, but it will also close down in December.

Keep ReadingShow less
Bennett Richardson

Bennett Richardson ( @bennettrich) is the president of Protocol. Prior to joining Protocol in 2019, Bennett was executive director of global strategic partnerships at POLITICO, where he led strategic growth efforts including POLITICO's European expansion in Brussels and POLITICO's creative agency POLITICO Focus during his six years with the company. Prior to POLITICO, Bennett was co-founder and CMO of Hinge, the mobile dating company recently acquired by Match Group. Bennett began his career in digital and social brand marketing working with major brands across tech, energy, and health care at leading marketing and communications agencies including Edelman and GMMB. Bennett is originally from Portland, Maine, and received his bachelor's degree from Colgate University.


Why large enterprises struggle to find suitable platforms for MLops

As companies expand their use of AI beyond running just a few machine learning models, and as larger enterprises go from deploying hundreds of models to thousands and even millions of models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

As companies expand their use of AI beyond running just a few machine learning models, ML practitioners say that they have yet to find what they need from prepackaged MLops systems.

Photo: artpartner-images via Getty Images

On any given day, Lily AI runs hundreds of machine learning models using computer vision and natural language processing that are customized for its retail and ecommerce clients to make website product recommendations, forecast demand, and plan merchandising. But this spring when the company was in the market for a machine learning operations platform to manage its expanding model roster, it wasn’t easy to find a suitable off-the-shelf system that could handle such a large number of models in deployment while also meeting other criteria.

Some MLops platforms are not well-suited for maintaining even more than 10 machine learning models when it comes to keeping track of data, navigating their user interfaces, or reporting capabilities, Matthew Nokleby, machine learning manager for Lily AI’s product intelligence team, told Protocol earlier this year. “The duct tape starts to show,” he said.

Keep ReadingShow less
Kate Kaye

Kate Kaye is an award-winning multimedia reporter digging deep and telling print, digital and audio stories. She covers AI and data for Protocol. Her reporting on AI and tech ethics issues has been published in OneZero, Fast Company, MIT Technology Review, CityLab, Ad Age and Digiday and heard on NPR. Kate is the creator of RedTailMedia.org and is the author of "Campaign '08: A Turning Point for Digital Media," a book about how the 2008 presidential campaigns used digital media and data.

Latest Stories