1. Technology
You can opt-out at any time. Please refer to our privacy policy for contact information.

How to Mine the Invisible Web: The Ultimate Guide

Search and Discover Untapped Invisible Web Resources


Man in boat looking through spyglass
Stephen Swintek/Stone/Getty Images

The Invisible Web refers to the vast amount of content and information that is not easily discoverable in a general search engine query, such as databases, private networks, or password-protected information. However, there are a wide variety of high quality Invisible Web search tools, search engines, and directories that can help you mine this fantastic resource that is considered to be at least 500 times larger than the visible Web.

The following Invisible Web resources will connect you to a virtual goldmine of knowledge, anything from medical dictionaries to moving picture archives to academically vetted articles and journals.

The Invisible Web: A Brief Introduction

The Invisible Web: What is the Invisible Web? Is it some kind of Area 52-ish, X-Files deal that only those with stamped numbers on their foreheads can access? Well, not exactly.....keep reading

Invisible Web Search Engines

Five Search Engines You Can Use to Mine the Invisible Web: There are many Invisible Web search tools that you can use to dive into this wealth of information, as you'll see from the following list.....keep reading

DeepDyve: If you're looking for scholarly research on a topic, you'll want to try DeepDyve, a search engine focused on the Invisible Web.....keep reading

The Search Engine List: All-purpose search engines, visual search engines, people search engines...you'll find all these and more in this list of search engines, a comprehensive guide to the best search engines on the Web....keep reading

FactBites: Factbites retrieves results that are academically oriented, i.e., dictionaries, encyclopedias, universities, and many .org sites (typically non-profit organizations).

Scirus: Scirus is a science search engine dedicated to only searching science-specific content....keep reading

Invisible Web Directories and Portals

Invisible Web Directories: Many individuals and institutions have put together invisible Web directories, which you can use as a jumping off point to surf the Invisible Web. Here are just a few...keep reading

Complete Planet: CompletePlanet is an Invisible Web portal with fast service, relevant results, and an easy to use interface. CompletePlanet searches over 70,000+ searchable databases and specialty search engines....keep reading

Medical Information on the Invisible Web: The Invisible Web has a goldmine of medical databases and specialized medical sites that just don't show up on a cursory search in the search engines. Best of all, this information is free....keep reading

Humanities and Literature Resources on the Invisible Web: There are plenty of humanities resources on the Invisible Web, such as arts, literature, and history Web sites that will give you greater insight on what you might be reading for a class or help you on a research project...keep reading

Invisible Web Research Databases and Reference Tools

47 Alternatives to Wikipedia: Wikipedia is perhaps the most popular reference site online, with millions of high quality articles available on virtually any topic. However, there are limits to what Wikipedia can offer....keep reading

How to Find Archives on the Web: Are you trying to find information about a historical event? Looking for online archives for news, music, popular culture, or movie information?...keep reading

Google Scholar: From one place, you can search across many disciplines and sources: peer-reviewed papers, theses, books, abstracts and articles, from academic publishers, professional societies, preprint repositories, universities and other scholarly organizations....keep reading

Find People with the Invisible Web

Invisible Web People Search Resources: The following resources can help you delve deep into the Invisible Web, making your people searches even more rich, detailed, and authoritative....keep reading

15 Search Engines to Help You Find Someone: Finding people on the Web is getting easier and easier. Here are fifteen people search engines you can use to find the person you're looking for on the Web....keep reading

How to Find Someone on the Web, Step by Step: Need to find someone? Here's a step by step guide to finding someone on the Web using tools and services that are designed to find people online....keep reading

Use the Invisible Web to Find Public Records

The Top Twenty Essential US Government Web Sites: There are literally hundreds of thousands of US government and government-related Web sites that offer free access to a wide variety of information....keep reading

How to Find Public Records: Here are the best free public record search databases online, from obituaries to census records....keep reading

Do a Background Check on the Web: You can use the Web to do a free background check via a multitude of free sources on the visible and invisible Web....keep reading

Books and Printed Materials on the Invisible Web

How to Find and Read Full Books Online: More people than ever before in history are using the Web as a free library, and with good reason: there are literally thousands of free books online that you can download in their entirety, listen to in an audio book version, or simply read within your browser window...keep reading

How to Find Works in the Public Domain: Public domain works are works whose copyrights were issued before 1923, and have now passed into the public domain, meaning that they can be used, reproduced, or incorporated in any way without any restrictions....keep reading

How to Find PDF Files: If you are trying to find PDF (Adobe Acrobat) files on the Web, there's a number of ways that you can accomplish this....keep reading

©2014 About.com. All rights reserved.