Can I add more than one XML sitemap in my Robots.txt File?
-
I have 3 domains all hosted on the same Magento Enterprise Platform. Each domain targets a different county.
.co.uk, .com.au, and .com.
Can I add all three sitemaps in my robots.txt file?
-
As an add-on, I would really suggest you to implement the rel="alternate" hreflang="x-X" tags in your sitemaps.xml in order to better your international SEO efforts and geotargeting.
Check this official post by Google
-
You can certainly add as many sitemaps to your robots.txt file as you want; however, the references in the sitemap should refer to the resources on the domain in question. For example, you won't want to include a sitemap reference on example.com's robots.txt that refers to URLs on example.co.uk.
If the sites have all the same pages, you can just include the same sitemap with relative URLs. You can also just add the correct sitemap to the correct domain in Google Webmaster Tools. Hope that helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Hreflang implementation via sitemap - don’t need canonical tags?
Hi, Quick easy question here I hope! An international site has hreflang and canonical tags in page head sections and also hreflang in the sitemap so I can see one version needs removing. The head section versions are relative URLs and need updating so think we will keep the sitemap hreflangs instead. If the sitemap implementation is going to be used (sitemap auto-updates when changes are made to pages so seems easier to do this way) am I right in thinking No canonical tags are needed at all (and can safely be removed from head section too?). Pretty sure links included in sitemap are assumed to be canonicals, or any issues with this approach? Will be using x-default for the default language version of homepage too.
International SEO | | MMcCalden0 -
How to Configure Robots.txt File
How to configure correctly the Robots.txt File of the website. Need proper process to follow.Because a lot of my website URLs are excluded by google with the issues in the Robots.txt file.
International SEO | | seobac1 -
Is this setup of Hreflang xml sitemap correct?
Hi, I'm trying to setup hreflang for 2 domains. One is purely a US site and the other domain has the language-country as subdomains. For example: http://www.websiteUSA.com (Targets English - USA) https://www.websiteINT.com/en-CA (Targets English - Canada) https://www.websiteINT.com/fr-CA (Targets French - Canada) https://www.websiteINT/es (Targets Spanish) ..and so on and so forth for about 12 of these international URLs. I created an XML sitemap that looks something like this: <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>http://www.websiteUSA.com</loc></url></urlset> <url><loc>https://www.websiteINT.com/en-CA</loc></url> <url><loc>https://www.websiteINT.com/fr-CA</loc></url> Question 1: Is this correct? In my actual file, I have all the countries listed and self-referencing. Question 2: I'm hosting this file at https://www.websiteINT.com/hreflang.xml AND at http://www.websiteUSA.com/hreflang.xml. Is this correct? Question 3: Will this help the SERPs direct english speakers from the US to http://www.websiteUSA.com while show SERPs for say English Speakers in Canada to https://www.websiteINT.com/en-CA? Question 4: For some reason, when I put up the xml site, it only listed each URL once instead of the full XML file. Should I have uploaded a text file instead? It doesn't seem to render correctly. Thank you!
International SEO | | SylviaH0 -
Multilingual website - Url problem (sitemap)
At this moment our website both uses the language in the url like "en" and localizes the url itself ("books" in english and "boeken" in dutch). Because of the history of making our website multilingual we have a system that takes the browser language for the localization if the url doesn't contain a language like "en". This means: www.test.com/books = browser language www.test.com/en/books = english language www.test.com/boeken = browser language www.test.com/nl/boeken = dutch language Now for the sitemap this makes it a little troublesome for me because which hreflang is used for which url? 1) The first thing I thought of was using x-default for all urls that get the language of the browser. <code><url><loc>http://www.test.com/books</loc></url></code> But as you can see we now got 2 times x-default. 2) Another solution I thought of was just use the localization of the url to determine the language like: <code><url><loc>http://www.test.com/books</loc></url></code> But now we got 2 of each language for the same page. 3) The last solution I thought of was removing links without a language in the url (except for the homepage, which will still have an x-default) like: <code><url><loc>http://www.test.comen/books</loc></url></code> But for this solution I need to put 301's at pages that are "deleted" and also need to change the system to 301 to the right page. Although the last point isn't really a problem I'm kind of worried that I will lose some of the "seo points" with a 301. (When we changed our domain in the past we had a bad experience with the 301 of our old domain) What do you think would be the best solution for SEO? Or do you have any other suggestions or solutions I haven't thought of.
International SEO | | Anycoin0 -
What is the best way to generate an automatic sitemap for google, bing and yahoo?
Hi guys, I have 3 international sites So far I recieved a Sitemap that was generated by an seo company to use and submit to google, for our co.nz domain, I have been told to submit this also to bing and yahoo. Can anyone tell me if I can submit the same sitemap for the com.au and com or would i need to generate a new sitemap for each domain? I have been told, everytime we change content we have to keep submitting, is there a way to do this autmatically as we will be writting alot of content daily. Any recommendations or suggestions?
International SEO | | edward-may0 -
Sitemap for multilanguage website
Hello sorry silly question but prefer to be sure 🙂 I have an international website with different subfolders .com/es .com .com/fr etc All of them have independant sitemap, but i'd like to add in .com/robot.txt a sitemap with language. Do you know how I can do this ? Tks a lot !
International SEO | | AymanH0 -
Can geographic location of web server affect in SEO?
I have server in Singapore. I need to target USA and Europe for my site. Whether I need to change server? Please guide me... Can geographic location of web server affect in SEO? If Yes, how it affect in SEO?
International SEO | | MayurChavda0 -
How can I see what my web site looks like from a different country?
I've tried a few proxy tools to try to see how my site looks from other global locations, but haven't found one that works very well yet -- or a list of reliable proxies around the world. I need to do this to test various geo-targetted ads and other optimizations. Can anyone make a recommendation? Thanks!
International SEO | | Dennis-529610