1. Home
  2. Computing & Technology
  3. Web Search

Attracting Crawlers To Your Site

By Wendy Boswell, About.com

Crawlers, also known as spider and robots, are just programs that search engines use to "crawl" from link to link and add data to that particular search engine's database. Here are some ways to attract them to your site so you can get more hits from users:
  • Include as many specific keywords as possible in your Meta tags. Spiders see these, and will use them to find your site.
  • Have as many external links as possible coming to your site. One way to do this is to submit your site to human-edited directories (Yahoo, dmoz.org).
More Web Search Quick Tips

Explore Web Search

More from About.com

  1. Home
  2. Computing & Technology
  3. Web Search
  4. Web Site Optimization
  5. Web Site Optimization Tips
  6. Attracting Crawlers To Your Site

©2008 About.com, a part of The New York Times Company.

All rights reserved.