Tek-Tips is the largest IT community on the Internet today!

Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!

  • Congratulations gkittelson on being selected by the Tek-Tips community for having the most helpful posts in the forums last week. Way to Go!

is the robots meta tag a guarantee that the page will/won't be indexed

Status
Not open for further replies.

spewn

Programmer
May 7, 2001
1,034
using this tag:

<meta name="robots" CONTENT="index,nofollow">

mean that definitely the page will be indexed, but the links won't be followed, no matter what search engine? or does it only matter for the SE's that read meta tags...

- g
 
It's a request for that to happen - there's no guarantee that SEs will honour it. The same can be said for robots.txt files. That said, I believe the ones that matter - Google, Yahoo, MSN - will abide by such instructions.

-- Chris Hunt
Webmaster & Tragedian
Extra Connections Ltd
 
The 'robots' meta name and the robots.txt file are for the benefit of the search engines, to save them searching down unnecessary paths. I doubt if the 'spamfinder' engines would even look at any restrictions you might try and impose - if it's linked, they will spider it.

________________________________________________________________
If you want to get the best response to a question, please check out FAQ222-2244 first.
'If we're supposed to work in Hex, why have we only got A fingers?'
Drive a Steam Roller
 
Status
Not open for further replies.

Part and Inventory Search

Sponsor

Back
Top