Robots.txt on http vs. https

[zeepartner]

We recently changed our domain from http to https. When a user enters any URL on http, there is an global 301 redirect to the same page on https.

I cannot find instructions about what to do with robots.txt. Now that https is the canonical version, should I block the http-Version with robots.txt?

Strangely, I cannot find a single ressource about this...

[BlueprintMarketing]

Glad to be of help. Check out this Google link to confirm you picked up the 180 day crawl

https://support.google.com/webmasters/answer/83106?hl=en

Second URLs helpful as well.

http://blog.raventools.com/moving-site-from-http-to-ssl/

all the best,

tom

[zeepartner]

Good point with the backlinks! Currently, both robots.txt files are open and google does not seem to have canonicalization problems so far. So it makes sense to leave it this way anyways... Thanks Thomas!

[BlueprintMarketing]

"Now that https is the canonical version, should I block the http-Version with robots.txt?"

Absolutely not GWT will handel all of it think about backlinks both https:// & http:// urls you will not want to lose the flow of link juice that you would cut off

Remake robost.txt with

http://www.internetmarketingninjas.com/seo-tools/robots-txt-generator/

But use https:// for the xml sitemap.