Using Javascript for web crawler

[kknorpp001]

Can Javascript be run from a local machine to do the following?

1. Perform a google search on a search term that is input by the user
2. For each resulting URL, follow all links on every page from that URL down (within the same domain) and note which page contains a given file type (also input by the user)
3. Display every URL found with number of files of the filetype on the page in descending order by number of files of a the file type files on the page.

Many thanks in advance...

 

[trollacious]

No. You'd need something like an ActiveX control or server-side scripting to grab the information from the other servers, parse it, perform all the tasks you listed, then create the page you described.

Lee

 

[kknorpp001]

Hello. Interesting. However, could I use a local program if I didn't need the results to be a web page? My primary concern is going over my traffic limit on my web hosting service.

 

[vbkris]

u could take a look at AJAX (XMLHTTP)

Known is handfull, Unknown is worldfull