Web Search

  1. Home
  2. Computing & Technology
  3. Web Search

Do Search Engines Search The Entire Web?

By Wendy Boswell, About.com

Do search engines search the entire Web?

In a word, no. Search engines have millions of pages in their databases (Google alone indexes close to eight billion), but none of them even come close to indexing the whole Web, let alone the Internet. What are some pages that they exclude?

  • The invisible web,, a vast repository of information that search engines don't have access to, such as databases
  • Private networks, called intranets, that are not actually hooked up to the Web
  • Forms, like ColdFusion or CGI
  • Password-protected sites, like a university library
  • Sites that intentionally, for various reasons, keep their information from being indexed by search engine spiders
More Web Search Quick Tips

Explore Web Search

About.com Special Features

Build Your Own Website

Step-by-step advice on how to do everything from choosing a Web host to promoting your content. More >

Connect Your Home Computers

Easy ways to connect two computers for networking purposes. More >

Web Search

  1. Home
  2. Computing & Technology
  3. Web Search
  4. Search Engines
  5. Do Search Engines Search The Entire Web?

©2009 About.com, a part of The New York Times Company.

All rights reserved.