Multilingual website - Url problem (sitemap)
-
At this moment our website both uses the language in the url like "en" and localizes the url itself ("books" in english and "boeken" in dutch). Because of the history of making our website multilingual we have a system that takes the browser language for the localization if the url doesn't contain a language like "en".
This means:
- www.test.com/books = browser language
- www.test.com/en/books = english language
- www.test.com/boeken = browser language
- www.test.com/nl/boeken = dutch language
Now for the sitemap this makes it a little troublesome for me because which hreflang is used for which url?
1) The first thing I thought of was using x-default for all urls that get the language of the browser.
<code><url><loc>http://www.test.com/books</loc></url></code>
But as you can see we now got 2 times x-default.
2) Another solution I thought of was just use the localization of the url to determine the language like:
<code><url><loc>http://www.test.com/books</loc></url></code>
But now we got 2 of each language for the same page.
3) The last solution I thought of was removing links without a language in the url (except for the homepage, which will still have an x-default) like:
<code><url><loc>http://www.test.comen/books</loc></url></code>
But for this solution I need to put 301's at pages that are "deleted" and also need to change the system to 301 to the right page. Although the last point isn't really a problem I'm kind of worried that I will lose some of the "seo points" with a 301. (When we changed our domain in the past we had a bad experience with the 301 of our old domain)
What do you think would be the best solution for SEO? Or do you have any other suggestions or solutions I haven't thought of.
-
The best way to go about this is to keep the URLs with the language in the structure. Redirect (301) the ones that don't have it to the ones that do.
However, it sounds like that causes a problem. If the above isn't a possibility, use a canonical from the non-language URL to the one with it. Then do your HREFLANG in sitemaps, and only use the URLs with the language tag in the sitemaps. You can also do the coding on the page, just make sure the HREFLANG tags are not on the non-language pages.
- Example URL: http://www.test.com/boeken would have a canonical tag that points to http://www.test.com/nl/boeken
- Only http://www.test.com/nl/boeken is listed in the sitemaps
- OR Only http://www.test.com/nl/boeken has HREFLANG tags. http://www.test.com/boeken would only have the canonical.
That should solve your problem.
-
From their support page (https://support.google.com/webmasters/answer/189077?hl=en) when you're combining region plus language you'll want to do this:
For example, you may have specific URLs for English speakers in Ireland (en-ie), Canada (en-ca), and Australia (en-au), but want all other English speakers to see your generic English (en) page, and everyone else to see the homepage. In this case you should specify the generic English-language (en) page for searchers in, say, the UK. You can annotate this cluster of pages using a Sitemap file or using HTML link tags like this:
That way you can even have a situation like nl-en or vice versa. I'd use 302s for redirecting based on conditional things like browser settings. Cheers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Problem to get multilingual posts indexed on Google
Last year on June I decided to make my site multi-lingual. The domain is: https://www.dailyblogprofits.com/ The main language English and I added Portuguese and a few posts on Spanish. What happened since then? I started losing traffic from Google and posts on Portuguese are not being indexed. I use WPML plugin to make it multi-lingual and I had Yoast installed. This week I uninstalled Yoast and when I type on google "site:site:dailyblogprofits.com/pt-br" I started seeing Google indexing images, but still not the missing posts. I have around 145 posts on Portuguese, but on Search Console it show only 57 hreflang tags. Any idea what is the problem? I'm willing to pay for an SEO Expert to resolve this problem to me.
International SEO | | Cleber0090 -
Changing the language of the website meta title and description?
Hello, Moz community! I'm planning to change the language of my website title and description from English to rank better for queries on the local language. Do you think this would increase the local language ranking? And in case I need to switch back to English, let's say in 2021, would it be difficult to regain the current rankings? Please let me know if you have any thoughts on this. Thank you!
International SEO | | vhubert2 -
What is the best way to generate an automatic sitemap for google, bing and yahoo?
Hi guys, I have 3 international sites So far I recieved a Sitemap that was generated by an seo company to use and submit to google, for our co.nz domain, I have been told to submit this also to bing and yahoo. Can anyone tell me if I can submit the same sitemap for the com.au and com or would i need to generate a new sitemap for each domain? I have been told, everytime we change content we have to keep submitting, is there a way to do this autmatically as we will be writting alot of content daily. Any recommendations or suggestions?
International SEO | | edward-may0 -
Auto-Redirecting Homepage on Multilingual Site
The website has an auto-redirecting homepage on a multilingual site. Here is some background: User visits the site for first time > sent to javascript age verification page with country of origin selector. If selects "France" then served French page (.com/fr-fr/). If selects any other country, then served English page (.com/en-int/). A cookie is set, and next time the user visits the site, they are automatically served the appropriate language URL. 1st Question: .com/ essentially does not exist. It is being redirected to .com/en-int/ as this is the default page. Should this be a 301 redirect since I want this to serve as the new homepage? 2nd Question:. In the multilingual sitemap, should I still set .com/ as the hreflang="x-default" even though the user is automatically redirected to a language directory? According to Google, as just released here: http://googlewebmastercentral.blogspot.com/2014/05/creating-right-homepage-for-your.html "automatically serve the appropriate HTML content to your users depending on their location and language settings. You will either do that by using server-side 302 redirects or by dynamically serving the right HTML content. Remember to use x-default rel-alternate-hreflang annotation on the homepage / generic page even if the latter is a redirect page that is not accessible directly for users." So, this is where I am not clear. If use a 302 redirect of .com/ to either .com/en-int/ or .com/fr-fr/, won't I then lose the inbound link value and DA/PA of .com/ if I just use a 302? Note: there is no .com/ at this moment. Any advice is appreciated. Thanks,Alex
International SEO | | Alex.Weintraub0 -
Exact Copy of website
We have a client who has the exact copy of his site twice (so three identical sites) in a com.au , .com .co.uk all the sites seem to be the same, cached at different times by Google- ranking is ok on main site which we are working on....Any thoughts?
International SEO | | OnlineAssetPartners0 -
Showing different content according to different geo-locations on same URL
We would like our website to show different content according to different Geo-locations (but in the same language). For example, if www.mywebsite.com is accessed from the US, it would show text (in English) appealing to North Americans, but, if accessed from Japan, it would show text (also in English) that appeals more to Japanese people. In the Middle East, we would like the website to show different images than those shown in the US and Asia. Our main concern is that we would like to keep the same URL. How will Google index these pages? Will it index the www.mywebsite.com (Japan version) in its Asia archives and the www.mywebsite.com (US version) in its North American archives? Will Google penalise us for showing different content across Geo-locations on the same URL? What if a URL is meant to show content only in Japan? Are there any other issues that we should be looking out for? Kindest Regards L.B.
International SEO | | seoec0 -
Multi-lingual Site (Tags & XML SiteMap Question)
We have two sites that target users in two different countries in different languages in the following manner: Site 1 es.site1.com - Spanish version Site 2 site2.com/francais/.............. Navigation and content are translated into the foreign language from English What is the best way to let Google know about these multi-lingual pages: A. Add the rel="alternate" and hreflang= in the source code for the hunders of pages we have. B. Or is there a tool we can use to crawl and create XML site maps for different language pages. What do we need to do in the XML site map so that Google know that sitemap1.xml for example relates to Spanish as an example many thanks
International SEO | | CeeC-Blogger0 -
Rel alternate use for multi regional website with english language and same content
I have a website targeting multi language and multi regional users. For example, my main site is www.abcd.com which is in English and targeting US. I have the same content in English which is targeting UK and India with www.uk.abcd.com and www.india.abcd.com. I want to avoid content duplication and help search engines to show the right pages on the country level searches. I have researched a bit and have come to conclusion of using re alternate tag. Can someone help me with how to place the codes for the same. Many thanks Mozers!
International SEO | | HiteshBharucha0