Using Meta-Search Engines

What is a Meta-Search engine?

 A meta-search, multi-threaded or multi-search engine searches other search engines' databases in parallel (at the same time) and collates the results (which usually consist of a predetermined maximum "number" such as 10, 20 or 30). The search engine does not maintain its own database. Major differences in the meta-search engines include:

Selection of Databases Searched

Most meta-search engines will search several of the "major" search engines at once, usually: Altavista, Excite, Lycos, Webcrawler, Yahoo and Hotbot. Sometimes because of an agreement with one search engine, the meta-search service will not search another, specified, search engine. A number of directories such as Looksmart, Galaxy, and/or smaller search engines and specialized databases such as Deja News (newsgroups), stock quotes, or news wires may also be included. 

Sometimes this is wonderful -- but at other times a lot false hits from irrelevant sources can create a bad search set. This is why the ability to customize is so important -- being able to choose which search engines your query is sent to. But this also requires some experience on the part of the user to be able to determine which search engines or databases to include in the search.

How Queries are Submitted to the Search Engines

Queries are submitted to each search engine at once (in parallel) or one or several at a time. I tend to prefer the "simultaneous" search myself -- I mainly use meta-search engines because I want to see what the search engines find all at once (some meta-search services ask if you would like to "Search X more search engines" instead of sending all queries at once).

Remember how each search engine uses different search syntax and has different advanced features such as Boolean, field and proximity searching? Well here's one of the main problems of meta-search services -- unless specifically stated otherwise, the advanced techniques will be filtered out. This is because the interface of the meta-search engine must be programmed to interpret your search syntax for each and every search engine it queries. As we all know, search techniques frequently change. For the most part, however, simple Boolean (and, or, not) are honored as well as implied Boolean (+ meaning "and" or "require" and - "exclude").

Manipulation and Presentation of Results

Depending on the kind of research I am doing, I may wish to see which search engine retrieved which hit, or results grouped by web site, or results ranked according to relevance and almost always to have the duplicates removed. Unfortunately, all of these features are not available through all meta-search utilities, so you have to choose which is most important to you (and this often varies with the search....). Most annoying, is when relevancy rankings are stripped.

If Meta-Searchers are so great and search my favorite search engines simultaneously, then why wouldn't I always use one?

Well.....again, it depends on what you are looking for...consider

When would I use one?

Use a meta-search engine when:

My favorites are:

Ask Jeeves, Dogpile, Inference Find, Metacrawler, Savvy Search

Meta-Search Engines

Assignments

The purpose of the assignment this week is to compare results across meta-search tools. Finding "the" answer to the question is not as important as comparing the search set results. Use a selection of the above tools. Post your observations to the class bulletin board and please keep those subject lines descriptive!

1. Search using my name (Angela Elkordy).

2. Search using your name.

3. Search for a general topic (such as "library science").

4. Search for a very specific topic (such as "dublin core" "metadata" and "collections").

5.  Find a meta-search tool not included in the above list.
  6. What are good search topics for meta-searchers? (generally..) Post one or two suggestions and tell us why they would be good candidates for a meta-search vs. single search engine.