In Search of the Right Search Technology for Your Customers

Hint: The answer is not always Google. CIOs share their hard-earned lessons.

June 21, 2007 — CIO — Mess up internal search and you’ll frustrate your employees. But mess up external search and you’ll alienate your customers. No wonder that e-commerce company execs like Jeff Zwelling of YLighting bear down hard on this problem: Zwelling changed his website’s search engine three times in the past four years, unhappy with the search results that his company’s site was giving customers—or rather wasn’t giving them. Nothing changed until the fourth try in late 2006.

Graeme McCracken, the COO of RB Search, a subsidiary of Reed Business charged with making the publisher’s content available through the consolidated Zibb.com site, faced the same frustration three years ago. His search engine didn’t give readers a complete, accurate picture of his company’s many magazines and newsletters.

Mired in the problems of external search, both companies found that the Google approach—the one most commonly tried first—doesn’t always keep customers happy. E-commerce and media businesses have similar needs for external search: guided navigation and contextual search to help users quickly narrow down their desired results using categories, user profiles and other metadata. Even database-driven e-commerce sites must go beyond database content to handle vague searches like “red lamp,” says Zwelling, YLighting’s president.

External (keyword) search must help customers get to the same result as using the site’s navigation, says Chris Cummings, CIO of online retailer eToys Direct.

By contrast, internal search focuses on discovering data “hidden” in documents, databases, and so forth. Google follows the internal search approach: Users typically want anything that answers their query, not a specific, repeatable result.

E-commerce vendors and content publishers have come to these realizations early, says Tony Byrne, founder of the research firm CMS Watch, because the success of search relates directly to sales of goods and advertising. But other businesses can use search to improve customer self-service (and reduce expensive calls and e-mails to customer support staff), he notes.

Such efforts are rare today. “There’s no revenue from better customer service, so it’s hard to fund these projects,” says Brian Babineau, a senior analyst at the consultancy Enterprise Strategy Group. But he expects savvy companies to follow the media and e-commerce firms’ examples to increase customer retention.

It's All About Context

Many search engines will give external users access to your website’s content. But not all provide the ability to infer context from the content and then let an enterprise refine and manage that context.

Leading players include Endeca Technologies, InQuira, Progress Software, SLI Systems, Visual Sciences and Vivisimo. All but InQuira and Vivisimo also offer search-based merchandising capabilities for e-commerce sites. SLI Systems provides its tools as a hosted service, while the other tools are designed to be deployed at the enterprise.

Teragram provides a tool to create the metadata from which various search engines can access the context.

Several companies can help you extend external search capabilities. For example, Baynote tracks users across the Web to build a profile of interests that a search engine can use invisibly to better target search results. And Nexidia offers search technology for audio and video content, using analysis of the audio to determine contextual matches to search terms.