Hiding pages from search robots

[domino3]

Can someone tell me how to hide by bulletin board from search robots? I've heard it can be done, but don't what the meta variable code should be.

Thanks

 

[Noconi]

The META tag to tell crawlers to ignore a page is:
<META NAME=&quot;robots&quot; CONTENT=&quot;noindex,nofollow&quot;>
or if you want the pages ignored, but the links on the pages followed:
<META NAME=&quot;robots&quot; CONTENT=&quot;noindex,follow&quot;>

I have found that the best way, however to keep pages from being indexed is to store them in a folder thats; name begins with an underscore, like /_bboard/

The underscore tells crawlers to ignore the contents of that folder.

Tiffany

Microsoft MVP - FrontPage

http://www.at-frontpage.com

http://www.anyfrontpage.com

http://www.frontpage-webtemplates.com

 

[Garridon]

Also you can build a robots text file that disallows search of specific folders or pages. You can find out more information at

http://www.outfront.net.

They have an article on robots.txt and links.

Please note though that both of these ways may not be 100% effective with all spiders. I have a disallow on one Web site I'm phasing out, and it's still getting picked up.