Scraper Detection 1

[Hondy]

Hi

Anyone know of any tools that can parse an IIS log to detect screen scraper operation? e.g. to identify IP addresses that make repetitive requests over a 24 hour period?

Thanks

 

[WhoKilledKenny]

A couple of guys from Microsoft created a great tool (free) for parsing logs.

http://www.logparser.com/

 

[Hondy]

Thanks for taking the time to reply. I was after a purpose built analyser specifically for detecting screen scrapers - do any exist?

 

[WhoKilledKenny]

Im not sure, there is a lot of info on the web regardig screen scrapers. Until you find one, you could use log parser to find instances of robots, strings, and/or code in your IIS logs.

Post back if you find a tool that is worth looking at.

 

[Hondy]

I'm not having much luck with this. Anyone know if there are any programs that will import the IIS log and show basic stats on it such as most frequent visitors?

I know you can get stats packages but i don't want to change our current one for this one task.

Thanks!

 

[ChrisHirst]

FunnelWeb Log Analyser

Chris.

Indifference will be the downfall of mankind, but who cares?
Woo Hoo! the cobblers kids get new shoes.
People Counting Systems

So long, and thanks for all the fish.

 

[Hondy]

Thanks Chris, that helped me out.

 

[WhoKilledKenny]

Very Nice, I Thank you too...