Why My Company Uses Amazon's EC2 Cloud

Got unpredictable demand for your company's Web-based service? Perhaps Amazon's Elastic Compute Cloud is the answer. Here's how one start-up cashed in on Amazon EC2.

By Rob Lemos
Mon, May 18, 2009

CIO — Running an Internet startup remains a tricky business, says link-sharing service ShareThis. During the past two years, more than 110,000 sites have added the ShareThis embedded link, allowing readers to forward articles or videos to their friends. The popularity has made the company's data requirements enormous: it handles up to 12,000 requests a second and 130 million page views every day.

In the planning stages, the startup realized that potential success would mean that it would have to establish a data center—and pay for provisioning the infrastructure—before its business took off, says Nanda Kishore, CTO of ShareThis. Understandably, the business balked at such costs.

"If you look at a traditional data center model, it is very clumsy," Kishore says. "Your need to buy capacity is always ahead of demand (and) if you don't have the traffic, you've built up all this capacity and you are stuck with a fixed cost."

The unpredictability of demand for the ShareThis service and the need to minimize up-front costs are two reasons why the company decided to outsource its needs and use Amazon's Elastic Compute Cloud (EC2) service, he says.

Exactly What is an Elastic Compute Cloud?

The much-discussed but often not-fully-understood EC2 technology is part of Amazon's Web Services infrastructure, an alphabet soup of computing services delivered via the Internet to give business access to flexible computing resources. With EC2, companies can provision a number of virtual computers—depending on their immediate processing needs—to crunch numbers and only have to pay for what they use.

ShareThis uses the data it collects from each customer site to analyze how content is forwarded amongst Internet users. The company crunches their link logs every night, adding them to its 10 terabyte data warehouse stored on Amazon's service. The process could take a single computer 100 hours, but ShareThis creates more than dozen virtual instances and finishes the job overnight.

"We do the data analysis in the cloud," Kishore says. "We instantaneously configure 100 compute hours to process these large files."

Not having traditional data center costs or management hassles allows ShareThis employees to focus on the business, not on managing its infrastructure, he says.

"You can do intellectually stimulating things, rather than turn the dials and knobs," says Kishore. "It feels like, to me, that this is an entirely new world, and it seems that here, there are large savings."

EC2 is the processing part of Amazon's Web Services. The Internet giant also offers the Simple Storage Service (S3) allowing customers to backup large quantities of data, the Simple Queue Service (SQS) for messaging between computers, and the Simple Database (SimpleDB) for structured-data storage needs.

The services have already taken off. According to Amazon, the bandwidth for EC2 and S3 has exceeded the bandwidth for all of Amazon's global websites. The storage service, S3, holds more than 52 billion objects and regularly peaks at 80,000 requests per second, according to the company.

The Usual Cloud Concerns Apply

However, customers interested in using Amazon's Web Services should be ready to change their applications to minimize costs, states Gartner analyst Lydia Leong in a research note on the service.

"Broadly, in cloud-computing environments, access to computing capacity is inexpensive, but access to storage is expensive," she states. "Consequently, applications written for such environments should trade off greater CPU usage, or more memory usage, for less I/O, whenever possible," she writes.

In addition, applications running on Linux instances are less expensive than those running on Windows instances, and instances that require less memory and a smaller number of processing cores are cheaper, she adds.

Companies that deploy applications on Amazon's EC2 must also be aware of the security considerations. EC2 instances have to secured, just like any other server connected to the Internet. While there is a user-configurable firewall, because the virtual machines are only accessible via the Internet, connecting internal systems to EC2 instances requires additional security precautions, Leong says. And, because Amazon does not provide details of its internal infrastructure, companies that have to comply with regulations may not have access to the necessarily level of auditing, she writes.

This story edited by Laurianne McLaughlin. Follow me on Twitter @lmclaughlin and Follow everything from CIO.com on Twitter @CIOonline

This ESG Lab Review documents hands-on testing of Simpana 9 software from CommVault, specifically its "OnePass" data change gathering and retention mechanisms as well as its integration with HP X9000 (IBRIX) scale-out NAS.
In this paper, Forrester Consulting examines the total economic impact and potential return on investment (ROI) realized by three Enterprise organizations as they virtualized mission-critical Oracle databases on the VMware vSphere platform. The purpose of this study is to provide readers with a framework to evaluate the potential financial impact of VMware vSphere on their organizations.
Even though virtualization has brought positive change to enterprise IT over the last decade, some skepticism remains about how valuable virtualization can be in the way companies deliver and run business applications. Uncover the truth about how you can run your business critical applications with confi dence without sacrifi cing
availability or service quality-and at lower costs.
This IDG whitepaper highlights key findings based on the Quickpoll Survey conducted with more than 300 Enterprise and Commercial IT decision makers worldwide about the state of their virtualization of business critical applications. This paper answers such questions as: What drivers are pushing companies to extend virtualization beyond servers? and What value are they realizing? Central to the paper are key results that expose risks of the past (fears of limited ISV support, performance impact) no longer are a factor for companies moving to 80+% virtualized.
The Kelley School of Business at Indiana University deployed VMware Infrastructure which decreases costs, streamlines server deployment, and reduces energy consumption.
New study quantifies how VMware improved TCO and ROI for three companies' IT landscapes.
As greater numbers of datacenter servers transition from the physical to the virtual world, the components of virtualization success come to the fore. What scores of organizations have discovered is that success is derived from an optimal pairing of the right software platform with the right hardware platform.
Virtualizing business-critical applications is an essential step in your journey to the cloud. Microsoft SQL Server, Exchange and SharePoint, and Oracle applications, are often the backbone of business IT. The benefits of virtualizing these applications extend far beyond mere consolidation. Understanding how VMware improves quality of service and agility while reducing costs will help you make the case for taking virtualization to the next level in your company.
Virtualizing business-critical applications has become a key focus for organizations as they move along their virtualization journey. With the launch of VMware vSphere® 5, VMware is helping customers accelerate the deployment of business-critical applications, including Exchange, SQL, SAP and Oracle.
Want to say goodbye to missed SLAs? VMware can help you virtualize mission-critical applications such as Oracle, MS Exchange and SharePoint to achieve dramatic improvements in uptime, performance and responsiveness. In this webcast, we'll discuss the key benefits of virtualizing your agency's most critical applications and Oracle databases as a necessary first step in fulfilling OMB's mandate to move IT services to the cloud. With VMware, you'll be on the way to quick, effective and full compliance.
Federal IT managers are on the forefront of realizing the benefits that a secure, easy-to-manage virtual desktop environment can provide. The key is how to deliver the end-user experience that is comparable to a physical desktop. This webcast will show how the recently released VMware View 5 environment is being used to deploy virtual desktops to provide mission-critical solutions around Disaster Recover/COOP, telework and secure mobile applications to federal organizations. View this webcast and learn how new features and benefits of the VMware View 5 environment meet the needs of Federal customers
This video webcast is designed to help those with little to no virtualization experience understand why virtualization and VMware are so important to driving down both capital and operational costs. The session will start with the introduction of the key concepts and technologies of virtualization, introduce the vSphere Hypervisor, and build up to an overview of VMware vSphere® 5, the world's most robust and complete virtualization platform. This session will also discuss new solutions such as the vSphere Storage Appliance and VMware GO that are making it easier than ever before to get started with virtualization.
Newsletter Sign-Up »

Receive the latest news test, reviews and trends on your favorite technology topics

Choose a newsletter
  1. View all Newsletters | Privacy Policy
Sponsored Links
Resource Center