| Indexes:
Spiders and Allies |
|
|
|
|
|
|
|
|
| w | Automatic
�spiders� (also robots, crawlers) |
||||||
| find
Web pages by following hyperlinks |
|||||||
| w | They
retrieve some portion of each page |
||||||
| (title,
first lines, full text) |
|||||||
| w | Indexer
adds the results to the database, |
||||||
| calculates
�relevancy� |
|||||||
| w | Query
processor responds to search requests |
||||||
