"Google" application

[JontyMC]

I have a requirement to create a search application on a website that will search web pages from a dynamic list of domains.

I've looked at google api and yahoo api, they both fall short of what I need, as the number of queries is limited. I've also looked at spidering the websites myself, but this is a vast undertaking requiring lots of bandwidth and server space.

Anyone know of any alternative api's or any other possible solutions?

Jon

"I don't regret this, but I both rue and lament it.

 

[BabyJeffy]

Scrape the google search engine? Proxy the requests from your search domain and return the results "scraped" to make it look like it came from your own back end.

Probably not a good business model... but it'd work... for a while

Cheers,
Jeff

[tt]Jeff's Page @ Code Couch

http://www.codecouch.com/jeff/blog/

http://www.coedit.co.uk/

[/tt]

What is Javascript? FAQ216-6094

 

[Wullie]

I've also looked at spidering the websites myself, but this is a vast undertaking requiring lots of bandwidth and server space.

How many sites are we talking about?

Hope this helps

Wullie

Fresh Look - Quality Coldfusion 7/Windows Hosting
YetiHost - Coming Soon

The pessimist complains about the wind. The optimist expects it to change. The leader adjusts the sails. - John Maxwell

 

[JontyMC]

800 initially, very large sites. Our server guy reckons we can fit 10 per server for the speed we require.

Jon

"I don't regret this, but I both rue and lament it.