I have a url which i don't want indexed:
So when i google search for "mysite.com", i don't want the above link to appear in the search results.
However, the following urls are part of public viewing:
www.mysite.com/moduleA www.mysite.com/moduleA?id=12345 www.mysite.com/moduleA/somepage.html
Can this be done? Can robots file be used for this?