searchdb – Webcrawler, Indexer and Search Engine Software

searchdb is an ASP.NET search engine written in VB.NET version 2. It incorporates a webcrawler, indexer and site search engine. The program uses a database to store the crawled pages and extracted words and the results are displayed in a way similar to popular internet search engines.

Features:

* Crawls and indexes static and dynamic web pages.
* Able to crawl multiple sites.
* Stores the crawled URLs and associated words in database tables.
* The word indexer extracts title, meta data, alt text and visible text from the web page.
* Common words are excluded by the word indexer and search engine.
* Search results are displayed in order of word hits in a way similar to popular internet engines.
* Written in VB.Net Version 2.
* Works with either Microsoft Access or SQL Server databases.
* User Agent for the crawler identified as “http://www.webconcerns.co.uk crawler”.
* Set up via password protected management displays.