Google's Robust Service on 9/11 Due to Scalability

By Meridith Levinson
Sat, December 01, 2001

CIO — At 7:30 a.m. PST on Sept. 11, 2001, Sergey Brin, cofounder of search engine and Web Business 50 winner Google, woke up to a phone call from a colleague who told him about the attacks on the World Trade Center and Pentagon. Hanging up the phone, he wanted more information, and visited several online news sites, including CNN.com and ABCnews.com. In spite of his hefty 6-megabit DSL Internet connection, none of the sites loaded. Thinking millions of Americans were likely having the same problem as they frantically groped for information about the attacks, he decided it was critical for Google to post cached copies of those developing news stories. (Google was selected as a Web Business 50 winner prior to Sept. 11 for its superior, easy-to-use search engine technology.)

In less than an hour, Google webmasters designed and sent an updated homepage to the company’s 10,000 Web servers nationwide. By midmorning on the West Coast, Google’s timely homepage appeared with links to copies of reports from otherwise inaccessible news sites.

Traffic on Google spiked the Tuesday of the attacks as visitors came to the site typing in queries for inaccessible news outlets as well as topics such as Osama bin Laden, Nostradamus and the FBI. It remained heavy for the next three days, but the site never buckled.

"I don’t think [the news sites] had ever planned for a worldwide news event of this magnitude," says Jim Reese, Google’s chief operations engineer. "We’ve spent our entire time as a business working on the very issue of scalability and capacity," he says.Indeed, Google has 10,000 computers distributed across data centers on the East and West Coasts. The company’s fleet of software engineers wrote code that distributes multiple copies of its data to each data center, which are linked to one another through multiple Internet connections. The company also performs load balancing between data centers and on individual Web servers. That means when someone sends a query to Google, it is automatically routed to the data center or Web server that is the least busy or has the smallest "load" of queries.

Even after the news sites were back up, traffic was heavy on Google. "Visitors realized immediately that they could now come to Google and do a search, or they could click a link and get a copy of the latest news website," says Reese.

As Active Directory's role in the enterprise has drastically increased, so has the need to secure the data. Gain insight on creating repeatable, enforceable processes that reduces administrative overhead and enables robust, customizable reporting and auditing capabilities. Brought to you by NetIQ.
This white paper from Forrester Research Inc., helps break PCI into understandable components. Security and risk professionals will gain knowledge and insight into creating a compliant and secure IT environment. Follow these four proactive steps now before your next audit. Brought to you by NetIQ.
Smarter Commerce is redefining the value chain in the age of the customer. It starts with putting the customer at the center of your operations - which of itself is not a new idea - however, truly operationalizing this strategy is not easy.
In this ever-changing world of software development, it's critical to keep up with technologies, methodologies and trends. Discover five tested and proven software development practices your team should be utilizing to accelerate software delivery.
A typical corporation spends between 60-80% of its IT budget maintaining existing systems. No wonder that many organizations are now considering modernizing legacy systems. In this whitepaper, three case studies illustrate how organizations have leveraged Make Technologies to modernize their legacy systems safely, efficiently, and inexpensively.
Aging application portfolios are putting many companies at risk. Typically, these organizations need a roadmap to modernize their application portfolios. This whitepaper discusses a step-by-step approach for legacy modernization, including portfolio assessment and developing a roadmap. It also considers necessary considerations for a scalable modernization project.
This webinar will cover five tested and proven software development practices that your team should be utilizing right now to accelerate software delivery.
Download this webcast to learn about the design considerations for virtualizing SQL workloads, performance and scalability information and high-availability options, as well as support considerations
Download this webcast to learn the virtual hardware design considerations for Exchange 2010, deployment using the building block approach, options for high-availability and disaster recovery and support considerations.
Virtualizing business-critical applications has become a key focus for organizations as they move along their virtualization journey. With the launch of VMware vSphere® 5, VMware is helping customers accelerate the deployment of business-critical applications, including Exchange, SQL, SAP and Oracle.
Want to say goodbye to missed SLAs? VMware can help you virtualize mission-critical applications such as Oracle, MS Exchange and SharePoint to achieve dramatic improvements in uptime, performance and responsiveness. In this webcast, we'll discuss the key benefits of virtualizing your agency's most critical applications and Oracle databases as a necessary first step in fulfilling OMB's mandate to move IT services to the cloud. With VMware, you'll be on the way to quick, effective and full compliance.
The complexity, cost and technological bloat of traditional Java EE application servers are often barriers to running a lean and efficient IT organization. Increased need for scalability and rapid application delivery are driving businesses to reconsider the platform they use for application deployment. By combining the portability and agility of the Spring framework with a lightweight application server, your organization can meet business demands while staying within budget constraints. VMware vFabric™ tc Server is a modern, lightweight Java application server based on Apache Tomcat. It improves developer productivity, control and manageability-and is the most flexible platform for virtualizing Java applications and workloads for the cloud. View this webcast to learn about real-world examples of companies that have adopted VMware vFabric tc Server and how to plan for future cloud deployments.
Newsletter Sign-Up »

Receive the latest news test, reviews and trends on your favorite technology topics

Choose a newsletter
  1. View all Newsletters | Privacy Policy
Resource Center