International Sites - Sitemaps, Robots & Geolocating in WMT
-
Hi Guys,
I have a site that has now been launched in the US having originally just been UK. In order to accommodate this, the website has been set-up using directories for each country. Example:
As the site was originally set-up for UK, the sitemap, robots file & Webmaster Tools account were added to the main domain. Example:
The question is does this now need changing to make it specific for each country. Example:
The sitemap and robots.txt for the UK would move to:
and the US would have its own separate sitemap and robots.txt. Example :
Also in order to Geolocate this in WMT would this need to be done for each directory version instead of the main domain? Currently the WMT account for the UK site is verified at www.domain.com, would this need reverifying at domain.com/en-gb?
Any help would be appreciated! Thanks!
-
Thanks for the insights. Very helpful. What about the robots.txt, though? Should it stay under http://www.example.com, where crawlers can find the file?
-
Yes, that's how I did it.
-
Thanks for the response, much appreciated.
Would this mean that the sitemap featured at www.domain.com would need to reference each directory version (UK & US etc etc), leaving the en-gb & en-us to reference just their own?
-
Hi, here's what Google officially has to say:
Webmaster Tools data and reporting work best on a site level. For example, if your site http://www.example.com has separate sections for different countries, we recommend adding each of those subsites or subfolders as a separate site. For example, if you have a travel site with specific subfolders covering Ireland, France, and Spain, you could add the following sites to your Webmaster Tools account:
- http://www.example.com
- http://www.example.com/france
- http://www.example.com/ireland
- http://www.example.com/spain
Following this I have solved the exactly the same problem you had for a client. And it works perfectly.
- _The question is does this ["sitemap"] now need changing to make it specific for each country. _What I have done is add the sitemaps for each subdirectory as well as the main domain. It works (tracking and all that) and is easy to do.
- _Also in order to Geolocate this in WMT would this need to be done for each directory version instead of the main domain? _Yes, that is the way to go.
- _Currently the WMT account for the UK site is verified at www.domain.com, would this need reverifying at domain.com/en-gb? _Yes, it does. And so do every other subdirectory you add down the line. That allows precise international targeting per subdirectory via the hreflang and country targeting settings and setting the main GWT site for the root domain to be for global traffic.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
An International SEO Conundrum
Hello all, I'm looking for opinions on this. Imagine there is a website example.com in English and the company 'Example' wanted to translate some of the pages (not not all) in to Russian. So they set up example.com/ru and translate the key pages into Russian. But half of the pages on.com/ru are left in English and there are no plans to translate them. How would you handle the pages in Engish on .com/ru? My thoughts are that they should: Canonicalise to the same versions on .com, and... Remove RU hreflang tags from the pages on .com/ru which are in English Otherwise, users searching in English with Russian browser settings could land on a page in English but then navigate to a translated page in Russian (+the menu navigation items will be in Russian) = bad UX. Not to mention they would be telling Google a page is in Russain but Google would be crawling English. So IMO, the best option is to use canonicals for this so that the .com version of the page is indexed. Then when a user lands after searching in English they will always be served English pages within that session. If English speakers/searchers land on the .com/ru page that would lead to a website half in one lang and half in another. I'm aware that Google recommends not using rel="canonical" across country or language versions of your site, but I believe they are making that recommendation based on an assumption that all pages are going to be translated to another language. In this case, there is no intention to do that, ever. Thanks for your thoughts and opinions. Cheers, Gill.
International SEO | | Cannetastic0 -
Local Address for International Business?
Our client's business www.shanore.com is based in Ireland but targets international markets, particularly the USA. A few months ago we made the switch to HTTPS and ever since our organic traffic has steadily declined in the USA, UK, Canada etc. by roughly 30 - 40%. In Ireland, over the same period of time it's increased by around 30%. An Irish address features in the Footer and the same address is also given on Google + / Google My Business. Webmaster Tools is set to target the USA & the site is hosted in the USA. Could the presence of the Irish address somehow be overriding the Webmaster Tools geo-targeting? Why would traffic fall everywhere else apart from Ireland? Keyword rankings are also now stronger in Ireland than in other countries.
International SEO | | Johnny_AppleSeed0 -
Duplicate product description ranking problems (off-site duplicate content)
We do business in niche category and not in English language market. We have 2-3 main competitors who use same product information as us. They all do have same duplicate products descriptions as we. We with one competitors have domains with highest authority in this market. They maybe have 10-20% better link profile (when counting linking domains and total links). Problem is that they rank much better with product names then we do (same duplicate product descriptions as we have and almost same level internal optimisation) and they haven't done any extra link building for products. Manufacturers website aren't problem, because these doesn't rank well with product name keywords. Most of our new and some old product go to the Supplemental Results and are shown in "In order to show you the most relevant results, we have omitted some entries very similar to the ... already displayed. If you like, you can repeat the search with the omitted results included.". Unique text for products isn't a option. When we have writen unique content for product, then these seem to rank way better. So our questions is what can we do externaly to help our duplicate description product rank better compared to our main competitor withour writing unique text? How important is indexation time? Will it give big advantage to get indexed first? We have thought of using more RSS/bing services to get faster indexation (both site will get products information almost at same time). It seems our competitor get quicker in index then we do. Also are farmpages helpful for getting some quick low value links for new products. We have planed to make 2-3 domains that would have few links pointint to these new products to get little advantage right after products are launched and doesn't have extranl links. Sitemap works and our new product are shown on front pages (products that still mostly doesn't rank well and go to Supplemental Results). Some new product have #1 or top3 raking, but these are only maybe 1/3 that should have top3 rankings. Also we have noticed problem that when we index products quickly (for example Fetch as Google) then these will get good top3 results and then some will get out of rankings (to Supplemental Results).
International SEO | | raido0 -
International SEO
Hi If you were developing a US version of an existing UK site then is this the correct format/instructions for on-page SEO. Ive taken quite a lot from Aleydas great post: http://moz.com/blog/the-international-seo-checklist but just want to confirm below is a good overall checklist to provide to clients developers ? Create US & UK country & language subfolders such as: domain.com/en-us/ and domain.com/en-gb/ Add 'rel=alternatehreflang' attribute according to google guidelines Add individual site map to each subfolder or will the hreflang attribute do or vice versa or both best? Don't redirect users via IP sniffing their location and serving up country/language version. Instead obviously link between language/country versions with a crawlable and very visible menu. Use the meta content language/country by adding the 'country-language' meta-tag in your html head Create individual profiles in GWT & GA for each country/language version and geotarget accordingly Localise content: spelling, currency, contacts etc Anything else re on-page/technical im missing ? Many Thanks
International SEO | | Dan-Lawrence
Dan [edited to fix formatting]0 -
Redirect the main site to keyword-rich subfolder / specific page for SEO
Hi,
International SEO | | Awaraman
I have two questions. Question 1: is it worthwhile to redirect the main site to keyword-rich subfolder / specific page for SEO? For example, my company's webpage is www.example.com. Would it make sense to redirect the main site to address www.example.com/service-one-in-certain-city ? I am asking this as I have learned that it is important for SEO to have keywords in the URL, and I was thinking that we could do this and include the most important keywords to the subfolder / specific URL. What are the pros and cons and how important is it to include keywords to folders and page URLs. Should I create folders or pages just the sake of keywords? Question 2: Most companies have their main URL shown as www.example.com when you access their domain. However, some multi-language sites show e.g. www.example.com/en or www.example.com/en/main when you type the domain to your web browser to access the site. I undertstand that this is a common practice to use subdomains or folders to separate the language versions. My question is regarding the subfolder. Is it better to have only the subfolder shown (www.example.com/en) or should you also include the specific page's URL after the subfolder with keywords (www.example.com/en/main or www.example.com/en/service-one-in-certain-city)? I don't really understand why some companies show only the subfolder of a specific language page and some the page's URL after the subfolder. Thanks in advance, Sam0 -
E-Commerce site in 2 languages - Duplicate content or not?
How does Google view this? Our current site works like:
International SEO | | bjs2010
www.domain.com/EN - English
www.domain.com/ES - Spanish All products are the same, just different language and different URL for them - is this good or bad? I thought of either Going with .co.uk or .com for "English" and a .es for "Spanish"
OR Subdomaining it. www.es.domain.com and www.en.domain.com Any advice appreciated!0 -
URL Structure for Multilingual Site With Two Major Locations
We're working on a hotel site that has two major locations. Locations currently live in separate domains. The sites target users from around the world and offer content in multiple languages. The client is looking into migrating all content into one domain and creating sub-folders for each location. The sites are strong in organic search, but they want to expand the keyword portfolio to broader keywords regarding activities, which they also market on their sites. The goal is to scale their domain authority as they have a really strong brand. The question is which would be a preferred URL structure in case content is finally migrated into one domain? - (we have doubts about were the lang folder should be placed as each location has different amenities and services). Here is what we had in mind: domain.com – this is the homepage domain.com/location-1 – to target English visitors domain.com/location-2 – to target English visitors domain.com/es/location-1 – to target Spanish visitors domain.com/es/location-2 – to target Spanish visitors
International SEO | | burnseo0 -
Will duplicate content across international domains have a negative affect on our SERP
Our corporate website www.tryten.com showcases/sells our products to all of our customers. We have Canadian and UK based customers and would like to duplicate our website onto .ca and .co.uk domains respectively to better service them. These sites will showcase the same products, only the price and ship from locations will change. Also, the phone numbers and contact info will be altered. The sites will all be on one server. On each of the sites there will be a country selector which will take you to the appropriate domain for the country selected. Will doing this negatively affect our rankings in the US, UK and Canada?
International SEO | | tryten0