Homepage indexation issue
-
Hello all,
I've been scratching my head about this one for a while now... Let me explain the situation.
I'm working on a multi-lingual website. Visitors are redirected (301) when they visit the homepage to the correct domain.com/en/default.html, domain.com/nl/default.html, domain.com/fr/default.html or domain.com/de/default.html based on browser language. I have doubts about the impact on the ability for Google to index the website because of that, but that's a problem for another day.
The problem I'm having right now, is that domain.com/nl/default.html, domain.com/de/default.html and domain.com/fr/default.html are all indexed. When I search for the URL in Google I get the correct page on number one so I'm pretty sure those are indexed correctly. When I search for domain/en/default.html though, the homepage appears without /en/default.html extension. Does this mean Google assumes the domain.com page is the same as domain.com/en/default.html even though the redirect that's in place?
Would be great if someone could shed some light on this.
Thanks in advance!
-
Questions
- This type of behavior is considered a temporary redirect. Maybe it's better to think of the name as a conditional redirect. In which case, "Oh, your browser is in FR, with that condition let's send you here..." The 301 is supposed to be used as an unconditional redirect, telling crawlers that you're trying to migrate from URL A to B permanently, so get rid of URL A.
- Not necessarily. VS a 301, yes. but scrapability is mostly down to linking and sitemaps.
- Yup.
- Nope. You'd want to interlink directly to the other languages anyways though in case the 302 doesn't work for whatever reasons. Then the link is passing authority and the user has an option available to them if they'd like to get there on their own.
- Right. It'd be best to interlink with hreflang on each as you never know for certain how someone arrives at those pages. Best to give them and crawlers the guidance to where the other translations reside.
You're welcome! Hopefully that clears it all up for you.
-
Thanks a lot for your answer. The follow up question above also continues on your answer. Would be great to hear your thoughts.
-
Thanks a lot for this one. I have never worked on these kinds of automatic redirects so I thought to stay away from them till I got the indexation issue fixed. But I understand from your answer the two might be related.
Just to clarify and make sure I'm doing the right thing.
The situation at the moment: domain.com -> browser language = EN -> 301 redirect to domain.com/en/default.htm
domain.com -> browser language = NL -> 301 redirect to domain.com/nl/default.htm
domain.com -> browser language = DE -> 301 redirect to domain.com/de/default.htm
domain.com -> browser language = FR -> 301 redirect to domain.com/fr/default.htmIn this situation using the query "site:domain.com", the results include the /de/, /nl/, /fr/ and domain.com, but excludes /en/.
You advise to change this in to: domain.com -> browser language = EN -> 302 redirect to domain.com/en/default.htm
domain.com -> browser language = NL -> 302 redirect to domain.com/nl/default.htm
domain.com -> browser language = DE -> 302 redirect to domain.com/de/default.htm
domain.com -> browser language = FR -> 302 redirect to domain.com/fr/default.htmI need to include a hreflang=x-default on the domain.com page.
A few question that pop-up in my mind:
I always thought a 302 was only used for temporarily redirects?
Does using a 302 improves the scrapability of the website?
Would it possibily result in /en/default.htm be indexed again?
Does a 302 pass along authority?
I assume I need to implement href lang on the /LANGUAGE/default.htm pages as well right?Thanks a lot!
-
As others have mentioned, using a 301 redirect in this situation is not the most efficient use case, especially if you want all versions of your site to be indexed and available to users.
For displaying regional content (e.g. you have the same content, but it is translated to a specific language on different page versions) you would want to use hreflang to tell Google that you have multiple versions and the regions they satisfy. This will allow Google to serve up the regional specific content to users in international Google search engines and Google will index/know which versions are appropriate.
Reference link: https://support.google.com/webmasters/answer/189077
Additional reference: https://support.google.com/webmasters/answer/182192?hl=en#2
-
If you can, get that 301 redirection issue solved first as it's definitely not the type of one you want to use for this behavior. Google specifically recommends, "... to automatically serve the appropriate HTML content to your users depending on their location and language settings. You will either do that by using server-side 302 redirects or by dynamically serving the right HTML content." From here: http://googlewebmastercentral.blogspot.com/2014/05/creating-right-homepage-for-your.html. They go further into the hreflang tags here: https://support.google.com/webmasters/answer/189077?hl=en.
After getting the 301 cleaned up, for finding indexed pages it's better to use the "site:" search based operator in Google, Google Webmaster Tools, and Analytics. But really, get that 301 changed. Cheers!
-
If I understand your post correctly, domain.com/de/default.html has a 301 redirect to correctly direct traffic to the appropriate home page for their language?
If that is what you are saying than the chances are the the domain.com/de/default.html is no longer being indexed because of the 301 redirect. That redirect tells the engines that the page has moved, so they stop crawling it. I am not an expert on redirecting home pages, but maybe look into Ref lang tags and REL canonical tags in place of the 301 redirect.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Webmaster Image Index Issue
I submitted the image sitemap in GWT and only few of them get indexed in google, but now the indexed images are also getting de-index. Any solution for it? See the attached E4hPDQE
Technical SEO | | tigersohelll0 -
Fake 404 Issue
Hello, I just had a problem my site started showing up 404 issues for all my wordpress pages and post but visually the page was loading with content but yet all pages and software including google WMT was showing the 404 issue. I never found the issue but was able to move the site into a new hosting and restore from a backup and it work. Google found the issue on Jan 27th and they remove all the pages with 404 from the index and I lost most of my top ranking I have since fix the issue and was wondering if google would restore my ranking in such a case? Regards, M
Technical SEO | | thewebguy30 -
301 and 200 Status Issues
Hi, Moz has highlighted that we have duplicate page content on our site, displaying the following: http://bmiresearch.com/press 200 status code and http://www.bmiresearch.com/press 200 status code We have setup a 301 redirect rule on http://bmiresearch.com/press to permanently redirect to http://www.bmiresearch.com/press and on Google inspect element network it shows this http://bmiresearch.com/press 301 status code which mean redirect to this URL permanently http://www.bmiresearch.com/press 200 status code Does anyone know why this might be occuring? Is it possible that because Google has index both URL http://www.bmiresearch.com/press and http://bmiresearch.com/press with 200 status code? If so how would we correct this? Thanks
Technical SEO | | carlsutherland0 -
Shopify duplicate content issue
We recently moved out site to shopify but now have a duplicate content issue as we have the same products in different collections. I have added canonical code to get rid of this but my webmaster tools still shows hundreds of duplicate pages. How can I tell if the code I added is working? How long will it take for google to recognise this and drop the duplicates from their index and is this likely to have a significant impact on SERPS? Our we page is www.devoted2vintage.co.uk. Thanks Paul
Technical SEO | | devoted2vintage1 -
AJAX and Bing Indexation
Hello. I've been going back and forth with Bing technical support regarding a crawling issue on our website (which I have to say is pretty helpful - you do get a personal, thoughtful response pretty quickly from Bing). Currently our website is set with a java redirect to send users/crawlers to an AJAX version of our website. For example, they come into - mysite.com/category..and get redirected to mysite.com/category#!category. This is to provide an AJAX search overlay which improves UEx. We are finding that Bing gets 'hung up' on these AJAX pages, despite AJAX protocol being in place. They say that if the AJAX redirect is removed, they would index and crawl the non-AJAX url correctly - at which point our indexation would (theoretically) improve. I'm wondering if it's possible (or advisable) to direct the robots to crawl the non-AJAX version, while users get the AJAX version. I'm assuming that it's the classic - the bots want to see exactly what the users see - but I wanted to post here for some feedback. The reality of the situation is the AJAX overlay is in place and our rankings in Bing have plummeted as a result.
Technical SEO | | Blenny0 -
What's the issue?
Hi, We have a client who dropped in the rankings (initially from bottom of the first page to page to page 3, and now page 5) for a single keyword (their most important one - targeted on their homepage) back in the middle of March. So far, we've found that the issue isn't the following: Keyword stuffing on the page External anchor text pointing to the page Internal anchor text pointing to the page In addition to the above, the drop didn't coincide with panda or penguin. Any other ideas as to what could cause such a drop for a single keyword (other related rankings haven't moved). We're starting to think that this may just have been another small change in the algorithm but it seems like too big of a drop in a short space of time for that to be the case. Any thoughts would be much appreciated! Thanks.
Technical SEO | | jasarrow0 -
Duplicate Content Issue
Hi Everyone, I ran into a problem I didn't know I had (Thanks to the seomoz tool) regarding duplicate content. my site is oxford ms homes.net and when I built the site, the web developer used php to build it. After he was done I saw that the URL's looking like this "/blake_listings.php?page=0" and I wanted them like this "/blakes-listings" He changed them with no problem and he did the same with all 300 pages or so that I have on the site. I just found using the crawl diagnostics tool that I have like 3,000 duplicate content issues. Is there an easy fix to this at all or does he have to go in and 301 Redirect EVERY SINGLE URL? Thanks for any help you can give.
Technical SEO | | blake-766240 -
Duplicate homepage content
Hi, I recently did a site crawl using seomoz crawl test My homepage seems to have 3 cases of duplicate content.. These are the urls www.example.ie/ www.example..ie/%5B%7E19%7E%5D www.example..ie/index.htm Does anyone have any advise on this? What impact does this have on my seo?
Technical SEO | | Socialdude0