Tek-Tips is the largest IT community on the Internet today!
Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!
-
Congratulations Westi on being selected by the Tek-Tips community for having the most helpful posts in the forums last week. Way to Go!
Prevent a Web site from Web catchers
- Thread starter globos
- Start date
You can protect your site from webcathers that reads robots.txt. But most of robots can be forced to ingore this.
You can also protect you site by sending some error to some of "User-agent"s but most of cathers have option to change what they send as "user-agent" string.
In general you shouldn't do this at all. If somebody want to download you site he will do it.
Michael Dubner
Brainbench MVP/HTML+JavaScript
You can also protect you site by sending some error to some of "User-agent"s but most of cathers have option to change what they send as "user-agent" string.
In general you shouldn't do this at all. If somebody want to download you site he will do it.
Michael Dubner
Brainbench MVP/HTML+JavaScript
- Status
Similar threads
- Locked
- Question