Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Moz Q&A is closed.

After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

Posts made by morg45454

Robots.txt - Do I block Bots from crawling the non-www version if I use www.site.com ?

my site uses is set up at http://www.site.com I have my site redirected from non- www to the www in htacess file. My question is... what should my robots.txt file look like for the non-www site? Do you block robots from crawling the site like this? Or do you leave it blank?

User-agent: *

Disallow: /

Sitemap: http://www.morganlindsayphotography.com/sitemap.xml

Sitemap: http://www.morganlindsayphotography.com/video-sitemap.xml

posted in Intermediate & Advanced SEO

morg45454

Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Moz Q&A is closed.

morg45454

@morg45454

Posts made by morg45454