i am setting up a test site and do not want it crawled by search engines.
I was wondering if the following 2-line code within the robots.txt will prevent any search engine from crawling the root and any other directories within the site. i.e. I do not want any part of the site crawled...
TIA!
User-agent: *
Disallow: /
I was wondering if the following 2-line code within the robots.txt will prevent any search engine from crawling the root and any other directories within the site. i.e. I do not want any part of the site crawled...
TIA!
User-agent: *
Disallow: /