You are here:About>Computing & Technology>Web Search> Web Search Engines> Do Search Engines Search The Entire Web?
About.comWeb Search
Newsletters & RSSEmail to a friendSubmit to Digg

Do Search Engines Search The Entire Web?

From Wendy Boswell,
Your Guide to Web Search.
FREE Newsletter. Sign Up Now!

Do search engines search the entire Web?

In a word, no. Search engines have millions of pages in their databases (Google alone indexes close to eight billion), but none of them even come close to indexing the whole Web, let alone the Internet. What are some pages that they exclude?

  • The invisible web,, a vast repository of information that search engines don't have access to, such as databases
  • Private networks, called intranets, that are not actually hooked up to the Web
  • Forms, like ColdFusion or CGI
  • Password-protected sites, like a university library
  • Sites that intentionally, for various reasons, keep their information from being indexed by search engine spiders
 All Topics | Email Article | | |
Advertising Info | News & Events | Work at About | SiteMap | Reprints | HelpOur Story | Be a Guide
User Agreement | Ethics Policy | Patent Info. | Privacy Policy©2008 About, Inc., A part of The New York Times Company. All rights reserved.