How well does Google's "Locale-aware crawling by Googlebot" work?
-
Hello,
In January of this year Google introduced "Locale-aware crawling by Googlebot."
https://support.google.com/webmasters/answer/6144055?hl=e
Google uses different crawl settings for sites that cannot have separate URLs for each locale. ......... This is basically for sites that dynamically render contend on the same URL depending on the locale and language (IP) of the visitor. If e.g. a visitor was coming from France, the targeted page would load in french. If a visitor was coming from the US the same page would load in English on the same URL.
Does anyone have any experience with this setup and how well it works?
How well do the different versions of a page get indexed, and how well do those pages rank?
In the example above, does the french content get indexed correctly?
Many thanks!
-
Many thanks! I was looking for examples of issues with this setup.
Some stakeholders find the dynamic solution appealing (as it is much easier to set up for us), thereby forgoing the opportunity to set up the site correctly for international indexing and ranking. I would like to be able to illustrate the potential shortcomings.
Many thanks again!
-
No personal experience with it - but seen already some cases on the Q&A where it generated problems. In one specific case all traffic outside Ireland was shown a default language page - inside Ireland the full content was available. None of the content was indexed by Google until the ip blocking was removed.
The note on the page you mention already gives a hint:
IMPORTANT: We continue to support and recommend using separate locale URL configurations and annotating them with rel=alternate hreflang annotations.
If your website has pages that return different content based on the perceived country or preferred language of the visitor (i.e., you have locale-adaptive pages), Google might not crawl, index, or rank all of your locale-adaptive content.
You can try it but you run a huge risk that your content will not be indexed or only partially indexed. Better to use the hreflang solution - as propose by Google.
Dirk
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Search Console International Targeting - Works for Hungary, but not Ireland - Why?
company.com (root)
International SEO | | scottclark
USA - lang="en" | GSC target: USA (shows US site in SERPs for "companyname" search)
company.com/hungary
Hungary - lang="hu" | GSC target: Hungary (shows Hungarian site in SERPs for "companyname" search)
AWESOMENESS company.com/ireland
Ireland - lang="en" | GSC target: Ireland (shows US site (doh!) in SERPs "companyname" search)
NOT RIGHT! It is our theory [please weigh in!] that because we don't have a company.com/usa folder, the TLD targeting (EN) is overriding other English language sites in some manner. In other words, the reason it's not overriding Hungary is because it's a different language. What must we do to get the Irish site ranked for "companyname" searches and to show by default in Ireland?0 -
Google does not index UK version of our site, and serves US version instead. Do I need to remove hreflanguage for US?
Webmaster tools indicates that only 25% of pages on our UK domain with GBP prices is indexed.
International SEO | | lcourse
We have another US domain with identical content but USD prices which is indexed fine. When I search in google for site:mydomain I see that most of my pages seem to appear, but then in the rich snippets google shows USD prices instead of the GBP prices which we publish on this page (USD price is not published on the page and I tested with an US proxy and US price is nowhere in the source code). Then I clicked on the result in google to see cached version of page and google shows me as cached version of the UK product page the US product page. I use the following hreflang code: rel="alternate" hreflang="en-US" href="https://www.domain.com/product" />
rel="alternate" hreflang="en-GB" href="https://www.domain.co.uk/product" /> canonical of UK page is correctly referring to UK page. Any ideas? Do I need to remove the hreflang for en-US to get the UK domain properly indexed in google?0 -
How is Google determining location for geotargeting
Hello, I have a question related to Geotargeting.
International SEO | | Lvet
Let's suppose I have a website: mysite.co.uk
As far as I understand Google will consider this site targeted for the UK and will appear on searches preferentially from the UK. What happen now if I have a person located in Spain (with a Spanish IP) and searching in Google.co.uk. Will mysite.co.uk still appear in searches? What are the factors that Google takes into account for Geotargeting? Thank you0 -
.com versus local domains
Hi all, One of my clients has local domain websites in various parts of the world (co.uk etc. etc.) and there has always been a discussion about where a move from local domain (the current set-up) to a targeted .com domain (i.e. .com/uk) would benefit from a SEO perspective. The main reasoning (seo-wise) that keeps coming up is that there'd only be one domain to link to which would help with link juice being passed around. Any thoughts as whether this would actually be the case or if this possible benefit would be outweighed by other cons? Recent moves (local to .com) from a few websites (the Guardian newspaper in the UK being the most recent one off the top of my head) has made me start thinking about it again! Diana
International SEO | | Diana.varbanescu0 -
Working with country specific domain names vs. staying with .com
I've recently inherited a client that has a country specific domain for Canada (.ca) but there is also a US branch for the company at the .com address. They have a direct competitor that operates also in the U.S. and Canada that has decided to operate entirely under the .com address and re-direct all .ca traffic to their .com address. When I compare the link analysis data for both the .ca, .com, and competitors site, I'm finding there is a huge difference between the .ca site and the competitors site, but not a huge difference between the .com site and the competitors site. For example, the domain authorities are as follows: myclient.ca (Canadian branch) - 22 myclient.com (US branch) - 46 competitor.com - 53 When I do a brand search for my client in Canada, the Canadian branch website shows up first, but the American one is second. At this point, would it be better for my client to consolidate the two branches into the .com address and focus on increasing external followed links to the .com website? Or, is there merit in continuing to create a separate inbound link strategy for the .ca site? Thanks.
International SEO | | modernmusings0 -
Same domain with different google effect seo ?
I have a domain www.abc.com for US market. Now i want to sell same services in Australia. I am thinking to buy www.abc.com.au . Because i think i will get rank more faster for .au in Australia because of .au . What do you guys suggest ?
International SEO | | afycon0 -
I rank well but I dont get any clicks !
Hi everyone, I am on page #1 position #2 with my keyword but doesnt get any clicks ! I think I know the problem but I desperatly need your opinion too. Here are some info about my site. what do you think the problem is? Thanks for your help. It means a lot. -My keyword's Global and Local montly search is 1300 (exact) -Seomoz Rank Tracker shows that I rank ( on Page #1, Position #2 in Google / United Kingdom) -I use always private browsing to check my rankings -my domain is a .com and I bought the domain name from godaddy -Hosting is 1&1 and their server is in Germany. Which is a shame, I ve just realized 😞 -My site ranks on Google.uk (The web) but doesnt rank Google.co.uk (pages from uk). Is this the problem? I ve just change the target country to United Kingdom using webmaster tool. Will it help? When I search a query , I dont change it to ''pages from uk'' it came automaticly (the web). Does people care and change it to the ""pages from UK"? I had some clicks at first when my site was page #1 position #8-9 but now its position #2 and I get no clicks at all. Thanks
International SEO | | Jorenr0 -
Risks of Migrating tld's to sub folders
Hi Guys, I am thinking of migrating our .co.nz and our .co.uk websites into sub folders on our .com website (eg: .com/uk and .com/nz). Do you think this is a risky strategy in regards to our performance in the localised search engines or should the centralisation of all these websites and their link authority into the .com help us move up the rankings? We are thinking of doing this in the next week, we have some really good rankings for the local googles, however we also have plenty of phrases sitting just on page 2 and I was hoping this might help boost them onto page 1? Has anyone else had experience migrating tld sites to sub folders on a .com and if so what was your experience of the impact on search rankings in the local googles and the timeframe that these changes took to have an effect? Did you have any negative results?
International SEO | | ConradC0