I have a site that has 65 different versions of itself.
-
I've just started managing a site that serves over 50 different countries and the entire web enterprise is being flagged for duplicate content because there is so much of it. What's the best approach to stop this duplicate content, yet serve all of the countries we need to?
-
Yes sir, I agree it will be a "bit of an effort". Thank you both for some great guidance and if there's anybody else that has other solutions to these types of issues, I welcome your feedback as well.
-
It may be a bit of an effort but is it possible that you can work your way through the pages and make the content, titles and descrptions unique so that they don't get flagged as duplicate content.
This has the added advantage of having a large number of pages targeted at your various keyphrases whereas other apporaches involving 301 redirects or rel="nofollow" reduce the duplicate content issue but also reduce the number of pages on which to target keyphrases across all of these pages. If they are acorss 50 countries is there a local spin that can be put on the content so that all the relevant terms are targeted for in their regions but so that Google doesn't see 50+ versions of the same site.
-
Thank You Flatiron,
Yes the content is on different servers due to the different countries they serve as well as the languages. The client's US site is what I am working to improve and they currently have over 2,500 Duplicate title tags and Meta-Descriptions out there. Would modifying the robots.txt file to instruct the SE's to simply crawl the one main site and ignore the others be the best solution? My train of thought is going back to a previous case I had with a previous company where their product list pages were seen as duplicate pages due to the fact that each of the "sort" parameters were being recognized as duplicates by the SE's. We had to write an instruction to only crawl the first sorted results.
-
Hi Ken,
Is the content actually exactly the same but running on different domains? That will determine how to approach this issue. If all the the content is the same you can either utilize 301 redirects or rel=canonical tags to help the engines view the multiple sites as a single site and combine any link juice that's associated with each of the 50 sites. If the content isn't actually duplicitous then it or the page titles are extremely similar. In the long run I would recommend localizing your content so as to not only help from an SEO perspective but to also improve the user experience and hopefully the conversion rates as well.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Correct site internationalization strategy
Hi, I'm working on the internationalization of a large website; the company wants to reach around 100 countries. I read this Google doc: https://support.google.com/webmasters/answer/182192?hl=en in order to design the strategy. The strategy is the following: For each market, I'll define a domain or subdomain with the next settings: Leave the mysitename.com for the biggest market in which it has been working for years, and define the geographic target in Google search console. Reserve the ccTLD domains for other markets In the markets where I'm not able to reserve the ccTLD domains, I'll use subdomains for the .com site, for example us.mysitename.com, and I'll define in Google search console the geographic target for this domain. Each domain will only be in the preferred language of each country (but the user will be able to change the language via cookies). The content will be similar in all markets of the same language, for example, in the .co.uk and in .us the texts will be the same, but the product selections will be specific for each market. Each URL will link to the same link in other countries via direct link and also via hreflang. The point of this is that all the link relevance that any of them gets, will be transmitted to all other sites. My questions are: Do you think that there are any possible problems with this strategy? Is it possible that I'll have problems with duplicate content? (like I said before, all domains will be assigned to a specific geographic target) Each site will have around 2.000.000 of URLs. Do you think that this could generate problems? It's possible that only primary and other important locations will have URLs with high quality external links and a decent TrustRank. Any other consideration or related experience with a similar process will be very appreciated as well. Sorry for all these questions, but I want to be really sure with this plan, since the company's growth is linked to this internationalization process. Thanks in advance!
International SEO | | robertorg0 -
International SEO Question: Using hreflang tags across two different TLDs.
Hi! My UK based company just recently made the decision to let the US market operate their ecommerce business independently. Initially, both markets were operating off the same domain using sub-directories (i.e: www.brandname.com/en-us/ , www.brandname.com/en-gb/ ) Now that the US team have broken away from the domain - they are now using www.brandnameUSA.com while the UK continues to use www.brandname.com/en-gb/. The content is similar across both domains - however, the new US website has been able to consolidate several product variations onto single product pages where the UK website is using individual product pages for each variation. We have placed a geo-filter on the main domain which is 301 redirecting North American traffic looking for www.brandname.com to www.brandnameUSA.com However, since the domain change has taken place, product pages from the original domain are now indexing alongside the new US websites product pages in US search results. The UK website wants to be the default destination for all international traffic. My question is - how do we correctly setup hrlang tags across two separate TLDs and how do we handle a situation where multiple product pages on the "default" domain have been consolidated into one product page on the new USA domain? This is how we are currently handling it: "en-us" href="https://www.BRANDNAMEUSA.com/All-Variations" /> href="https://www.BRANDNAMEUSA.com/All-Variations" />
International SEO | | alexcbrands0 -
License Details across multiple regional brand sites
Hi guys! I have a quick question. Our team are currently having a debate regarding whether we should display our licensing details as text across all our brands in multiple regions (roughly 50 sites). My argument is that if you are required to have a license to be able to operate legally that Google would EXPECT to be able to crawl those details in order to provide their (Google) users with reliable results as opposed to rogue operators. The other side of the argument is that it will tie all the sites together and that would be a huge risk (as Google will perceive it as a network)- also that it would be seen as duplicate content? Would really appreciate any feedback on what is the best to do in this case. Thanks!!
International SEO | | RedSearch010 -
Duplicate Content - International Sites - AirBNB
Good morning Just a quick question. Why does AirBNB not get penalised for duplicate content on its sites. For example, the following two urls (and probably more for other countries), both rank appropriately in the google (UK and COM), https://www.airbnb.co.uk/help/getting-started/how-to-travel
International SEO | | joogla
https://www.airbnb.com/help/getting-started/how-to-travel Their are no canonical tags, no Alternative etc If I look at the following https://www.airbnb.co.uk/s/London--United-Kingdom
https://www.airbnb.com/s/London--United-Kingdom They both have alternative to point to the other language versions which I would expect. However they also both point to them selves as canonical. Would this not be duplicate content ? Thanks for your insights Shane0 -
Delivering different content according to country
Hey, I have a question regarding different content according to country (IP)-
International SEO | | Kung_fu_Panda
We planing to serve mobile users using dynamic HTML serving (on the same url)
Is it possible to serve different content for different devices + different IPs (for example different content for a user from US android and someone from UK android ) thanks!0 -
Multi-lingual Site (Tags & XML SiteMap Question)
We have two sites that target users in two different countries in different languages in the following manner: Site 1 es.site1.com - Spanish version Site 2 site2.com/francais/.............. Navigation and content are translated into the foreign language from English What is the best way to let Google know about these multi-lingual pages: A. Add the rel="alternate" and hreflang= in the source code for the hunders of pages we have. B. Or is there a tool we can use to crawl and create XML site maps for different language pages. What do we need to do in the XML site map so that Google know that sitemap1.xml for example relates to Spanish as an example many thanks
International SEO | | CeeC-Blogger0 -
Why don't our English versions show up first?
If I google "greatfire" I find the Chinese version of our website (zh.greatfire.org) before the English version (en.greatfire.org). This is not on the Chinese-language version of Google. Why is this? Our site even has a language indicator () and also hints of where the English version is (). The same thing happens if I google "freeweibo". I find https://freeweibo.com but not https://freeweibo.com/en/, even though we indicate that's the English version (). Any ideas?
International SEO | | GreatFire.org0 -
Is duplicate content really an issue on different International Google engines?
i.e. Google.com v.s. Google.co.uk This relates to another question I have open on a similar issue. So if I open the same e-commerce site (virtually) on company.com and company.co.uk, does Google really view that as duplicate content? I would be inclined to think they have that figured out but I havent had much experience with international SEO...
International SEO | | BlinkWeb0