I have placed my product showcase on subdomain such as http://demo.domain.com/productname/. Demo version of product is located at http://demo.domain.com/productname/demo/. I would like to disallow crawling demo version, can someone help me ?


The robots.txt must be in the root; if you have placed your Demo Version Of product in subdomain's folder then you need to change subdomains robots.txt file which should be aka; http://demo.domain.com/robots.txt


user-agent: *
disallow: /productname/demo
allow: /

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.