Homepage is deindexed in Google
-
Happened sometime on the 12th or 13th of Feb (is there a way to tell exactly besides referring to GA?).
I've been on the Google Webmasters Tools forums trying to nail this down - https://productforums.google.com/forum/?utm_medium=email&utm_source=footer#!msg/webmasters/OgpmNCc3IFA/mmtgUilyXUUJI can only think that Google is viewing this as duplicate content from an internal page for example: http://mudlifeled.com/shop
Very frustrating because we were moving up on the first page for some good brand key words and traffic was climbing.
Now I've got my hands up and am at a loss to what I can do.
-
Glad I could help
-
Back in business! Thanks for the help Chris!
-
ok...think we are getting somewhere. When I typed this in google by accident: site://www.mudlifeled.com
The page shows up:
https://www.mudlifeled.com
Since I had the https page set to noindex - Google was not indexing it. But it still doesn't explain why the http was not indexed and why all of a sudden it is now deindexed when the way I had the site setup has been crawled like this for almost a year? Maybe Google saw enough backlinks to https and said: "hey - we want to use the https version instead. Too bad you have it set to noindex"?Now that I have the canonical displaying from https to http on all pages - I'm hoping it reverts back to the http version and I get my keyword rank back. As of right now - I'm not seeing it in G's SERPs. fingers crossed
-
It could have just needed some more time for the canonical to work, still a bit on the odd side of things..
-
Now the index is showing:
<cite class="_Rm">www.mudlifeled.com/?taxonomy=product_type&term=simple</cite>
as the first result of a site: lookup
ugh
-
Yeah me too
It seems others can see the home page with site:www.mudlifeled.com outside the USA. But not inside of the USA.
Everything is good from the the suggested link.
I'm banging my head against my desk...lol
-
I'm a little stumped, as it should be working (and is for me) you could try giving it a bit more time with that canonical to take affect. I've tried looking via a proxy and i can't see it in American search compared to the UK search.
did you try looking through here - http://moz.com/ugc/8-reasons-why-your-site-might-not-get-indexed
-
I'm not seeing the homepage yet :(. Though using the canonical method did jiggle some lower level pages back into the index. Yikes - this is weird. Any other suggestions?
-
Just an update: seems to be working now for me (I was unable to see homepage before)
-
No the canonical makes the robots surplus, it tells Google its a duplicate of where ever you pointed the tag to, this also means any links also sort of get redirected too (in a sense)
-
I ask because it seems that viewers can see the homepage outside the USA.
One of the first things I did when I took over the site in April of 2014 was claim both in webmasters tools.
I have made the canonical change as suggested. Should I keep the meta robots tag as well?
-
I am located in the UK, however I am also finding it odd.
Couple of things I'd look into is to claim both http & https in webmaster tools, rather than block the robots, change it for a canonical tag which tells Google you're preferred domain and also can help with your link juice flow.
Have to admit I'm in a bit of a pickle though..
-
Fetch is good. No errors with fetch or render.
The only update I made was from WooCommerce 2.2 to 2.3. This has not effected the output or markup of anything of importance.
Are you located in the USA?
-
No manual webspam actions found.
-
You can check here - https://www.google.com/webmasters/tools
your site >Search Traffic > Manual actions
-
From what I can tell - I have no manual penalty.
Is there a way to check this outside Webmasters Tools?
I'm not seeing the homepage at all in the index. I've checked on outside computers with myself not being logged into google here in Florida.
My analytic data is confirming that there is a definite drop of hits to the homepage. -
a canonical link would work better and mean you're not shooting your self in the foot so much see more here -
https://support.google.com/webmasters/answer/139066?hl=en
how does fetch as Google work out for you? Did you also review what you were doing prior to this happening to see if a change you made has triggered this?
edit
One quick thought did you set up https redirects on the main homepage correctly and that's whats causing you an issue?
-
Hi Chris,
Thanks for the reply.
All HTTPS is blocked by design to keep from any possible duplicates with HTTP.
Michael Shinosky
-
Hi Keszi,
Thanks for the reply.
Being a WordPress site - I have not touched the format of the canonical tags since I took over managing the website in April of 2014.
Michael Shinosky
-
Your main site is index when I'm looking, you've blocked some of your pages with a noindex and nofollow tag in your meta robots which wont be helping you
e.g. https://www.mudlifeled.com/product-category/aurora-d-series/
try to remove the meta robots tag, (this overrides the robots.txt)
Good news your main page is indexed by Google, also if you do have to noindex a page at least it follow.
EDIT I also assume you don't have any sort of manual penalty and that you have checked
-
Hi Michael,
I am not quite sure, but I have a gut feeling telling me it has something to do with your canonical tags. When did you implement those? (cannot run a crawl now, but I will surely check it out in the evening).
Gr., Keszi
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Stuck trying to deindex pages from google
Hi There, We had developers put a lot of spammy markups in one of our websites. We tried many ways to deindex them by fixing it and requesting recrawls... However, some of the URLs that had these spammy markups were incorrect URLs - redirected to the right version, (ex. same URL with or without / at the end) so now all the regular URLs are updated and clean, however, the redirected URLs can't be found in crawls so they weren't updated, and couldn't get the spam removed. They still show up in the serp. I tried deindexing those spammed pages by making then no-index in the robot.txt file. This seemed to be working for about a week, and now they showed up again in the serp Can you help us get rid of these spammy urls? edit?usp=sharing
Technical SEO | | Ruchy0 -
Is this going to be seen by google as duplicate content
Hi All, Thanks in advance for any help that you can offer in regards to this. I have been conducted a bit of analysis of our server access file to see what googlebot is doing, where it is going etc. Now firstly, I am not SEO but have an interest. What I am seeing a lot of is that we have URL's that have an extension that sets the currency that is displayed on the products so that we can conduct Adwords campaigns in other countries, these show as follows: feedurl=AUD, feedurl=USD, feedurl=EUR etc. What I can see is that google bot is hitting a URL such as /some_product, then /someproduct?feedurl=USD and then /someproduct?feedurl=EUR and then /someproduct?feedurl=AUD all after each other. Now this is the same product page and just has the price shown slightly different on each. Would this count as a duplicate content issue? Should I disavow feedurl? Any assistance that you can offer would be greatly appreciated. Thanks, Tim
Technical SEO | | timsilver0 -
What does Google PageSpeed measure?
What does the PageSpeed tool actually measure? Does it say that a webserver is fast or slow? Thanks in advanced!
Technical SEO | | DanielMulderNL0 -
Google Penalty Investigation
Hi All, I've recently had a google penalty, and have spent a long while working through tying up any loose ends with my site (I'm building a new one, so you'll still see some probs on my current one). My search referrals do slowly seem to be recovering, but only for variations of terms that are similar to 'bike repair'. Now, my site does primarily offer bike repair advice, so that's a good thing, but I'm not yet ranking for any of my specific keywords. One example is that I used to rank quite high for the term 'schrader valve'. Is this a signal of anything in particular? Or can I not read anything specific into this? Thanks!
Technical SEO | | madegood0 -
Odd Google Indexing Issue
I have encountered something odd with Google indexing. According to the Google cache my site was last updated on April 6. I had been making a series of changes on April 7th and none of them show up in the cached version of the site (naturally). Then, on the 8th, my rankings seem to have dropped about 6 places and the main SERP is showing a text that isn't even on the Web site. The cached version has the correct page title from the page that was indexed on the 6th. How do I learn where Google is picking this up from? There is a clean page title tag on my Web site. I've checked the server, etc to see what's going on. The text isn't completely unrelated, but it definitely impacted my ranking. Does Google ever have these hiccups when indexing?
Technical SEO | | VERBInteractive0 -
How to ask for forgiveness from the Google God?
Ok so maybe not ask for "forgiveness" because I am not sure what we did to get penalized. I believe our site is being penalized 1. most of our usual keywords are not ranked in their usual placements in the search results. 2. some of our keywords are listing the wrong pages as search results and 3. our search results are landing on pages 8 or 9 on Google (not 2 or 3 as before). This is an ecommerce site. How do we figure out what trigger the penalty (if at all) and how do we fix it so that we can get our ranking back (is that even possible)? Please advise - much help is needed!
Technical SEO | | mof3kz0 -
About Google Spider
Hello, people! I have some questions regarding on Google spider. Many people are saying that "Google spiders only have US IP address." Is this really true? But I also saw video from Google's offical blog and it said "Google spider come from all around the world." At this point I am really confused. Q1) I researched and it seems like Google spiders have only US IP address. THen what does exactly mean by "Google spider come from all around the world."? Q2) If Google spider have only US IP address, what happen to site which use IP delivery? Is this means that Google spider always redirect to us site since they only have US IP? Can anyone help me to understand?? One more questions! When Google analyzing for cloaking issue, do you think Google analyze when spider crawls the site or after they crawled the site?
Technical SEO | | Artience0 -
Google Shopping Australia/Google Merchant Centre
So Google Shopping has finally landed in Australia so we've got some work todo hooking it up to our client ecom sites. Right now we have a handful of clients who are setup, the feed is getting in their ok but all products are sitting in "disapproved" status in the dashboard and clicking into each individual product the status says awaiting review. I logged a support ticket with Google to get some more info on this as it doesn't look right to me (ie the disapproved status in dashboard) and got a useless templated answer. Seems that if I switch the country destination to US the products are approved and live in google.com shopping search within the hour. Switch back to Australia and they go back to disapproved status. Anyone having the same issue/seen this before? I simply don't trust Google support and wondering if there's other factors at play here.
Technical SEO | | Brendo0