how to make a search engine

[omersiddiqui]

I want to develop a search engine like yahoo, or msn search... Does anybody have any idea of how to do that ??

REgards
Sajid

 

[ReneV]

Your question is too generic.

But to give you some clues:
* You'd need to look at the data you want to have searchable
* determine who your clients are and what they hope to find in the data
* determine how much the data changes
+ possibly have 2 repositories if you're dealing with lots of people updating the data AND lots of ppl searchin in it; one repository of data that's used by searches and another in which updates are put. The two repositories are then automagically synced.

Your technical choice is probably based upon other questions aswell. First analyze what you want to do, then tell us so we can make suggestions on what would work well.

 

[omersiddiqui]

I dont have the data thru which I will search... I will have to search through the internet,,, exactly like yahoo or altavista does....
I want to have only a text box ( not what google or yahoo provides), but my own, and when users types something in it and Submit, I want it to crawl through the different internet sites, and look for the word user is searching for.
So how can i develop this??

Regards

 

[ReneV]

this is a very difficult problem you're trying to solve.

first you need to think what you want to index on the internet. Then think on how you're going to store that, and then think about how your clients are going to access your search-engine.

btw; yahoo and altavista do very different things. yahoo is a directory while altavista is a textsearch engine. Yahoo you must apply for to be listed, altavista just searches all/most machines on the web.

 

[luciddream]

there are companies that allow you to use thier databases for a price... it is very expensive, but, running a large portal always is.

one such company is

http://www.inktomi.com

and i think google offers their databases also.