Tek-Tips is the largest IT community on the Internet today!

Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!

  • Congratulations gkittelson on being selected by the Tek-Tips community for having the most helpful posts in the forums last week. Way to Go!

Hi all, 2 questions in mind :) 1

Status
Not open for further replies.

JoJoH

Programmer
Jan 29, 2003
356
US
Hi all,

2 questions in mind :)

1) Will spider crawl files that has not been linked to from the main site? I don't think it would but just want to make sure :)

2) Where do people usually store files that manage their web site data if they are using a web host instead of their own server?

JoJoH

 
Hi Jojoh,

1) Unless there is a link to the file somewhere on the Internet, a spider will not find it. The exception to this is if your server allows directory listings, in this case a link to the directory listing will show the spider where to find the files.

2) Not sure what you mean by this. What "files to manage website data" are we talking about?

Hope this helps

Wullie


The pessimist complains about the wind. The optimist expects it to change.
The leader adjusts the sails. - John Maxwell
 
Thanks Wullie for the reply! Sorry for the confusion, I meant Data Management files, like pages created to update the web site's backend(database) etc.

Thanks again for your help!

JoJoH

 
If your host allows you to have subdomains, create one called "admin" or whatever and add htaccess so that it is protected.

If they don't allow you to have subdomains, just drop the files and a htaccess into a directory on your server.

If a spider ever comes across this directory or subdomain, it will get a authorisation request from the server and ignore the page.

Hope this helps

Wullie


The pessimist complains about the wind. The optimist expects it to change.
The leader adjusts the sails. - John Maxwell
 
Thanks Wullie, thats a great idea, talking about "authorization request", if it is a human, not a robot that is trying to access that forbidden directory, is it easy to crack the username/password(say with their specialize hacking software?) Please advice.

Thanks in advance.

JoJoH

 
Any secure area can be broken, it's more a question of how long will it take.

Htaccess is a secure method for use on the web though, the people who can bypass it will have the knowledge to gain access another way anyway. Actually, most likely they would use another way than trying to bypass htaccess.

Hope this helps

Wullie


The pessimist complains about the wind. The optimist expects it to change.
The leader adjusts the sails. - John Maxwell
 
Status
Not open for further replies.

Part and Inventory Search

Sponsor

Back
Top