Why Benchmarking Cloud vs. Current IT Costs is So Hard

Cloud providers make their services' costs quite transparent, says CIO.com's Bernard Golden. The trouble is, for most companies, current data center costs remain opaque. Will new tools help?

By Bernard Golden
Wed, December 02, 2009

CIO — A couple of weeks ago I was asked to moderate an HP-sponsored meeting on the subject of virtualization. Predictably, most of the discussion (attended by press and vendors including Citrix, Microsoft, Red Hat, and VMware) focused on cloud computing. It was a pretty lively session, but what I want to address here is an HP product portfolio called "IT Financial Management" that was discussed, along with its implications for cloud computing. As you might guess, the product focuses on financial analysis of IT operations, which is extremely relevant to the adoption of cloud computing.

Naturally, one of the topics raised during the panel was the potential cost benefits of cloud computing.

[For timely cloud computing news and expert analysis, see CIO.com's Cloud Computing Drilldown section. ]

And, as one might expect, there was a lot of ambiguity about the putative financial benefits of cloud computing. While there was a lot of nodding about the undoubted benefits, no one offered concrete examples. I will say, however, that we've seen significant TCO savings in the projects we've done, but, as moderator, it wasn't appropriate to discuss them.

The paucity of examples is troubling. Most of the organizations that have implemented cloud solutions have done so with an intuitive belief that inexpensive, pay-by-the-use computing must be less expensive than the current asset-heavy, low-automation environment characteristic of most IT organizations. But they've forged ahead, mostly, without real proof.

The reason for this, however, lies not with the cloud providers. Their pricing is, on the whole, quite transparent. Amazon, for example, displays its pricing on its website and even features a nifty online calculator that may be used to figure out how much a given application topology and usage will cost.

The problem lies, instead, on the other side of the comparison ledger—the cost of the incumbent solution placed within an internal data center. Most IT organizations cost assessment is extremely coarse-grained. Typical is a cost assignment that imposes a per-server charge and then assigns a general overhead cost for IT headcount and general costs based on the using organization's overall proportion of the corporate cost structure. Put another way, there is little ability to assess the actual marginal cost of an individual server; instead, a server comes with a fee plus the knowledge that a rather large surcharge will be delivered sometime in the future.

One can debate the reasons why this opaque cost methodology exists. My view is that IT used to be a very small part of an overall corporate budget and it didn't seem worth trying to perform fine-grained assessment on what was, in effect, rounding error. In the past 10 or 15 years IT expenditures have gone up precipitously, turning a small issue into a much larger one—but one still without adequate tools in place to address it.

At this event HP discussed a new (or pretty new, anyway) product called "IT Financial Management" (certainly not the most compelling of names, one must admit). It is designed to enable fine-grained cost assignment through an examination of existing expenses and assignment of them to a structured chart of accounts which can then be applied to individual applications. In short, the product (and service, since shoveling through existing costs and assigning them to appropriate categories and ultimately to individual applications is labor-intensive) helps show the "current cost" side of the today-vs-cloud TCO comparison that is such a hot topic.

Intrigued, I asked about the product after the event. I got the impression that the product is new enough that there are not a lot of concrete results from customers, but that there is a lot of interest in it. The HP executive who described it, Ramin Sayar, used system admin span as an example of cost comparison. He noted that cloud providers are able to obtain spans of one admin to 10,000 machines, perhaps, while internal IT groups run ratios of around one admin to 70 machines.

I believe that the data a product like this turns up will be in high demand over the next couple of years, as the battleground around cloud computing shifts from "what is it? I don't trust it" to "how much benefit will I realize if I use cloud computing?" A key metric for this latter question will be TCO comparison—and a discussion that leaves out half the comparison because the data is hard to get won't be acceptable in the future.

And what might be turned up if such a comparison were performed?

A year ago Bechtel, the giant construction firm, benchmarked its costs for a number of common IT resources against cloud providers. Remember, this was Bechtel, a very large and financially well-off company which one would assume would be a very capable IT user, with as efficient an operation as could be obtained.

In fact, Bechtel found that its cost structure was wildly higher than the best-of-breed cloud providers. Here are some of the numbers from Bechtel's benchmarking exercise:

1. Internet traffic cost Bechtel $500/MB; in the cloud that cost $10-$15/MB (YouTube.)

2. With regards to sys admins Bechtel had one admin per 100 servers; in the cloud, one admin per 17,000 servers (Google.)

3. Storage cost Bechtel $3.75/GB/month; in the cloud that cost $.10/GB/month (Amazon).

As a result of this benchmark exercise, Bechtel re-engineered its IT. It built three super-efficient data centers with high utilization rates. It raised storage utilization rates from single digits to 70%. Likewise, its server utilization rates grew to 70%. And it stopped using public Internet providers and installed its own fiber optic connectivity to Internet peering points.

The investment Bechtel was able to make, however, won't be possible for most organizations. They will be stuck with their old, high-cost business processes, unable to fund new data centers and bespoke fiber optic connectivity. For these organizations, transparent cost comparisons, once available, will force a discussion of how to begin the shift to lower-cost methods of IT. Offhand dismissal of cloud computing providers as "must be more expensive, after all, they're trying to make a profit" will be a thing of the past. Despite each of the comparison providers in the Bechtel example being profit-seeking organizations, they were able to operate far less expensively because they've been built from the ground up to be efficient.

I expect products/services like IT Financial Management will be in high demand over the next 18 - 24 months as organizations seek clarity about their IT cost structures and begin serious work on squeezing out IT costs. We'll see restructuring, not trimming. And we'll see a lot more use of cloud computing.

Bernard Golden is CEO of consulting firm HyperStratus, which specializes in virtualization, cloud computing and related issues. He is also the author of "Virtualization for Dummies," the best-selling book on virtualization to date.

Follow Bernard Golden on Twitter @bernardgolden. Follow everything from CIO.com on Twitter @CIOonline.

Similar to this Article
What is Tech Briefcase?
TechBriefcase is a new, free service where IT Professionals can Search, Store and Share IT white papers and content like this. Learn more
Bookmark content
Speed up your research efforts with content across the web.
Search and Store
Find the white papers you need. Create folders for any topic.
View Anywhere
Open your briefcase on your iPhone, tablet or desktop. Share with colleagues.
Don't have an account yet?
HP VirtualSystem delivers best-in-class virtualization, with integrated software, services, infrastructure, and management - all delivered as one proven solution.

Intel and the Intel logo are trademarks of Intel Corporation in the U.S. and/or other countries.
In this report, Enterprise Strategy Group reviews how HP's portfolio of hardware, software, and services can provide the foundational support for VMware environments. When it comes to business continuity, HP Converged Storage streamlines virtualization initiatives, accelerating realization of the business benefits that contribute to IT's ability to maintain high service levels and customer satisfaction.

Intel and the Intel logo are trademarks of Intel Corporation in the U.S. and/or other countries.
When AlertBoot switched to the cloud it needed a load balancing solution that would support its migration and prevent as much downtime as possible. The company chose Riverbed® Stingray™ Traffic Manager to use while transitioning its infrastructure to an entirely virtualized environment. The move was a complete success, at one-third the cost of comparable hardware solutions.
With over 5,000 requests per second during peak periods, online retailer Gilt Groupe could lose a large percentage of its daily profits in just 10 minutes of downtime. After choosing the Riverbed® Stingray™ Traffic Manager as its load balancing solution, visits to the site have increased thanks to improved customer satisfaction. Real-time traffic views and tracking also make it easy to strategize and plan for the future.
With 85 percent of its ticket sales made online, See Tickets needed a robust, secure, highly accessible website. The company chose the Riverbed® Stingray™ Traffic Manager to ensure that its site was always online and fast, even during extreme peaks in traffic. Now the company's valued customers receive optimal online service.
Triboo specializes in managing e-commerce activities and performance marketing for many Italian companies. The company's website was struggling to support over 2 million page views and 45 million hits each day, so they turned to Riverbed® Stingray™ Traffic Manager. Now Triboo enjoys high website availability and scalability, and its customers enjoy an outstanding online experience.
As greater numbers of datacenter servers transition from the physical to the virtual world, the components of virtualization success come to the fore. What scores of organizations have discovered is that success is derived from an optimal pairing of the right software platform with the right hardware platform.
Second in a three-part series discussing the "4 Must Haves" in virtualization security designed to help large organizations understand the challenges of securing virtualized environments while positioning themselves to take advantage of future IT and business opportunities.

Gain insights into next generation, virtualization-optimized solutions to help you drive:

+ Faster time-to-value from your security initiatives
+ Provide corporate with visibility and enable a state of continuous compliance
+ Reduce risk via automated configuration and policy-based access and enforcement engine
Date: Tuesday, July 17, 2012 2:00 PM EDT

Traditional NAS systems don't scale beyond fixed limits. Proliferation of NAS systems leads to management challenges. Many organizations also use traditional block-based SAN solutions for transactional systems like databases and email. Having separate block and file storage also adds to management challenges.
Have you been thinking about what it would take to start using virtualization? Or do you know the basics and want to find out more? No problem. This webcast is designed for anyone with little to no knowledge of virtualization technology. Attend this webcast to learn:

-A basic overview of the business value of the technology and some key capabilities that make virtualization so valuable to IT and the businesses you serve.
-The basics for creating virtual machines and the key choices that can be made along the route to deployment.
Capacity management may not be dead yet, but with the adoption of private clouds it's barely recognizable. Join Andrew Hillier as he outlines best practices for gaining control over dynamic capacity supply and workload demand in large scale virtual and cloud infrastructure. Hear how leading Fortune 500 organizations increased agility, reduced risk and costs by optimizing infrastructure planning and management processes.
Disaster recovery is a form of insurance to protect your IT assets when a disaster strikes. Learn how to protect your business in this insightful webinar.
Newsletter Sign-Up »

Receive the latest news test, reviews and trends on your favorite technology topics

Choose a newsletter
  1. View all Newsletters | Privacy Policy
Sponsored Links

Master the cloud with the power of convergence from HP

Connect with IT leaders redefining mobility at the Enterprise Mobile Hub

Choose New and manage one device instead of 170

Choose New for 8x the firewall and NAT performance

Check out a smart way of mobilizing your business with enterprise-ready Samsung Mobile.

Redefine your data center with HP servers.

Enhance your business with Windstream IT Solutions. Speak to someone local.

BlackBerry® Mobile Fusion. Different mobile devices. One platform.

Click to see how Accenture has delivered high performance to clients

CYBERMARYLAND | Learn Why Maryland is the Epicenter for Cybersecurity

Get Ethernet speeds from 1 Mbps to 10 Gbps - Comcast Business Class

Cognizant. Leading in Business, Application & Technology Services

Collaboration: driving better business outcomes

Gain cutting-edge insights at MIT in 2-5 day executive programs.

Complimentary Gartner Report on BYOD: Media Tablets & Beyond. View Now

Elevate storage agility and efficiency with HP 3PAR storage.

Choose New and slash the number of devices you manage

Customized information views & Twitter events at New Fulcrum Point

Splunk translates machine data into "aha" moments for IT and the business.

ManageEngine Desktop Central - Automate and Audit Your Desktop Management! Learn More...

Cloud Readiness Starts with Intel® Technology

High performance. Delivered. Click to see Accenture's client successes

Visit the Virtually There Learning Page to learn how to use virtualization to your competitive advantage.

Free: Hunter Muller's "The Transformational CIO."

Join us for an upcoming Microsoft 365 live online demo event.

Discover your easiest path to unified communications

Virtualizing Your Infrastructure Just Got Easier

Connect with global CIOs now at Enterprise CIO Forum

Resource Center