Robots.txt or meta tags?

[FesterSXS]

What are peoples thoughts on the above?

Am I right in assuming that using a robots.txt file is the standard way to instruct SE robots and that the robots meta tags are not really supported.

Tony

Spirax-Sarco - steam traps control valves heat exchangers
Sun Villa - Luxury Florida accommodation

 

[Wishdiak]

FesterSXS,

It really depends on the search engine. Some ignore robots.txt and some ignore the <meta name="robots" content="noindex,nofollow"> tag.

There's no real harm in implementing both, although some search engines will ignore both and do what they want anyway.

Wishdiak
A+, Network+, Security+, MCSA: Security 2003

http://www.wishdiak.com

 

[BillyRayPreachersSon]

I'd say that the search engine optimisation forum is a more appropriate place to discuss this:

http://www.tek-tips.com/threadminder.cfm?pid=828

Dan


[tt]D'ya think I got where I am today because I dress like Peter Pan here?[/tt]

 

[FesterSXS]

i agree Dan - I thought thats where i'd posted - i think i hit 'Back' once too many


Tony

Spirax-Sarco - steam traps control valves heat exchangers
Sun Villa - Luxury Florida accommodation