Definition: The term crawler is just another word for spider and robot. These are basically software programs that crawl the Web and index site information for search engine databases.
Next word: Dead Link
Also Known As: spider, robot
Crawler
By Wendy Boswell, About.com Guide
More about Crawlers
How to Use Crawlers to Your Advantage
More about Crawlers
Web Search Terms Beginning With C
Explore Web Search
Must Reads
- How to Find Free Movies Online
- Free Public Records and How to Find Them
- Find People with Google
- Use the Web to Find a Cell Phone Number
- Where to Find Free Books On The Web
Most Popular
By Category
- About.com
- Computing & Technology
- Web Search
- Web Search Glossary
- Web Search C Terms
- Crawler - What is a Crawler?
©2012 About.com. All rights reserved.
A part of The New York Times Company.