Google Adds 'on Demand' Indexing to Site Search

By Juan Carlos Perez
Thu, November 13, 2008

IDG News Service —

Google will enhance its hosted site search service for businesses on Thursday by letting Web publishers trigger a re-indexing of their site whenever they want.

The new feature gives control to Web publishers over the frequency with which Google refreshes its index of the site's content, something that until now had been automatically scheduled by Google's system based on internal algorithms.

Site Search's On-Demand Indexing will go live on Thursday. In their Site Search control panel, Web publishers will see a new button labeled "index now" that, when clicked on, will activate this new feature.

"On demand indexing is like supercharging the Site Search product so that our customers -- the Web site owners -- can come to Google as their Web sites are changing and say 'I just added 100 or 1,000 pages -- please index them now,'" said Nitin Mangtani, Google's lead product manager for enterprise search.

On-Demand Indexing should come in handy when a site has been redesigned and is being relaunched or when a lot of content has been added to it or changed, he said.

The newly-indexed pages should become searchable no later than 24 hours after the re-indexing is requested.

"We're giving new pages a fast-pass so they can be quickly indexed and get through our indexing pipeline right away," he said.

Site Search, a Web hosted service that doesn't require any software installation by customers, is designed for companies that want to use Google technology to power the search engine on their sites.

Previously called Google Custom Search Business Edition, Site Search got its current name in June, along with a set of significant upgrades, including a more comprehensive indexing capability and more granular options for ranking search results.

Site Search starts at an annual US$100 for Web sites of up to 5,000 pages and includes up to 250,000 search queries per year. A $500 second tier exists for sites with 5,001 to 50,000 pages and also limits queries to 250,000 per year.

The price goes up to $850 per year for sites with between 50,001 and 100,000 pages, but the annual query ceiling rises to 500,000. For sites with 100,001 to 300,000 pages the price is $2,250 per year with a 500,000 annual query maximum.

Web publishers with larger sites need to contact Google for pricing. Currently, thousands of businesses use Site Search, including Adobe and Con Edison, according to Mangtani.

A less sophisticated Web hosted site search service called Custom Search Engine AdSense for Search is free and requires Web publishers to carry Google ads.

Google also sells the Mini and Search Appliance computers, which use Google search engine software to index both a company's publicly available Web pages as well as internal files and documents with access restrictions.

Learn how your answer to this question compares to your peers by taking this quick poll. See how your peers are dealing with the challenge of ensuring a highly capable server infrastructure as technological shifts impact the application server platform.
With increasing data growth, comes increased need for data security.  The existing DLP model, with a focus on compliance/enforcement is not sufficient as the data discovery and classification capabilities are not granular enough.  Read this paper to find how you can efficiently and accurately manage your risk by rapidly inventorying and classifying your data and then developing remediation workflows that support business needs. 
This paper breaks down attack sources into four categories: external, malicious insiders, accidental insiders, and unknown.
The rapid growth of data and technology is creating challenges for organizations as this digital data is considered to be business communications and must be preserved according the same industry-specific regulations governing the retention and discovery of emails and more traditional forms of electronic communications. This paper examines the role that Data Loss Prevention ("DLP") technology can play in helping organizations address the challenges of locating information in response to electronic discovery.
This research, conducted by the Ponemon Institute, focuses on issues relating to the use of data protection solutions such as endpoint encryption and data loss prevention within the workplace.
This report, by Jon Oltsik from Enterprise Strategy Group, examines the need for a new business-centric approach to DLP in order to align business and security requirements.
As greater numbers of datacenter servers transition from the physical to the virtual world, the components of virtualization success come to the fore. What scores of organizations have discovered is that success is derived from an optimal pairing of the right software platform with the right hardware platform.
Have you been looking to hear about customer's experiences with the new VMware vCenter Site Recovery Manager product? View this webcast to learn about VMware customer, Navicure, and their experiences testing and evaluating the recovery manager, their progress in implementing it in their environment and their advice other customers considering using vCenter.
Many enterprises have discovered that the use of virtualization to support desktop workloads creates a range of significant benefits. These benefits include price efficiencies, improved IT management and greater agility and choice for end users.

This VMware sponsored webcast with IDC will provide both quantitative measurement of the business value -- defined as the expected ROI -- and qualitative analysis associated with the use of VMware View™. IDC will also provide an analysis of the View Composer and ThinApp™ features of VMware View, including the business value of these solutions and an overview of how they work.

Attend this webcast to learn about:
- Challenges and barriers that might impede the adoption of desktop virtualization
- Navigating roadblocks to facilitate a strategic implementation
- Optimizing qualitative and quantitative benefits to IT and your business
VMware recently announced VMware vFabric™ Data Director, a new database deployment and operations platform that enables enterprise IT organizations to offer database as a private cloud service. Built on top of VMware vSphere 5, vFabric Data Director enables IT organizations to ontrol database sprawl through automation and consistent policy enforcement and accelerate application development cycles with self-service database management. Attend this webcast to learn how vFabric Data Director can help you build database-as-a-service in your datacenter.
A simple, cost-effective disaster-recovery solution for virtual environments is high on the agenda for IT organizations as they virtualize more business-critical applications with VMware. VMware vCenter™ Site Recovery Manager-the market-leading disaster-recovery product-ensures the simplest and most reliable disaster protection for all virtualized applications. VMware vCenter Site Recovery Manager provides centralized management of recovery plans, enables nondisruptive testing and automates site-failover processes.
Traditional disaster recovery solutions are often too expensive, complex and unreliable to meet business requirements. As a result, IT departments are hesitant to expand disaster protection beyond their most critical applications, largely because they are uncertain whether the quality of the protection is really worth its cost. VMware vCenter™ Site Recovery Manager 5 is the market-leading disaster recovery product that addresses this situation for organizations of all kinds. It complements VMware vSphere to ensure the simplest and most reliable disaster protection for all virtualized applications.
Newsletter Sign-Up »

Receive the latest news test, reviews and trends on your favorite technology topics

Choose a newsletter
  1. View all Newsletters | Privacy Policy
Resource Center