REVEALING THE SECRETS OF THE DEEP WEB

Posted on August 3, 2009 by Jeffrey Newman

The Deep Web

Most search engines like Google try to help you find a needle in a haystack. Now, there are new kinds of search engines that scour the “deep web,” the hidden and mostly unexplored region of the web that few ever see, to help you search the haystacks with the most information you are looking for.

Kosmix (www.kosmix.com) is a deep web start-up with software that matches searches with with databases most likely to yield relevant information and then sends you an overview of the topic drawn from multiple sources.

Prof. Juliana Freira at The University of Utah is working on a project called DeepPeep (www.deeppeep.org) which seeks to index every database on the public web.

Today, deep web searches serve “vertical interests” like medicine and business but some companies like Deep Web Technologies are looking for ways to make the deep web available to the public. This company will customize search engines to fit the searchers interests and needs.

For a neat white paper on the topic, go to www.completeplanet.com