Google dropping pages from SERPs even though indexed and cached. (Shift over to https suspected.)
-
Anybody know why pages that have previously been indexed - and that are still present in Google's cache - are now not appearing in Google SERPs?
All the usual suspects - noindex, robots, duplication filter, 301s - have been ruled out. We shifted our site over from http to https last week and it appears to have started then, although we have also been playing around with our navigation structure a bit too.
Here are a few examples...
Example 1:
- Live URL: https://www.normanrecords.com/records/149002-memory-drawings-there-is-no-perfect-place
- Cached copy: http://webcache.googleusercontent.com/search?q=cache:https://www.normanrecords.com/records/149002-memory-drawings-there-is-no-perfect-place
- SERP (1): https://www.google.co.uk/search?q=memory+drawings+there+is+no+perfect+place
- SERP (2): https://www.google.co.uk/search?q=memory+drawings+there+is+no+perfect+place+site%3Awww.normanrecords.com
Example 2:
- SERP: https://www.google.co.uk/search?q=deaf+center+recount+site%3Awww.normanrecords.com
- Live URL: https://www.normanrecords.com/records/149001-deaf-center-recount-
- Cached copy: http://webcache.googleusercontent.com/search?q=cache:https://www.normanrecords.com/records/149001-deaf-center-recount-
These are pages that have been linked to from our homepage (Moz PA of 68) prominently for days, are present and correct in our sitemap (https://www.normanrecords.com/catalogue_sitemap.xml), have unique content, have decent on-page optimisation, etc. etc.
We moved over to https on 11 Aug. There were some initial wobbles (e.g. 301s from normanrecords.com to www.normanrecords.com got caught up in a nasty loop due to the conflicting 301 from http to https) but these were quickly sorted (i.e. spotted and resolved within minutes). There have been some other changes made to the structure of the site (e.g. a reduction in the navigation options) but nothing I know of that would cause pages to drop like this.
For the first example (Memory Drawings) we were ranking on the first page right up until this morning and have been receiving Google traffic for it ever since it was added to the site on 4 Aug.
Any help very much appreciated! At the very end of my tether / understanding here...
Cheers,
Nathon
-
Sorry denverish, I have been really busy lol
Point number 3 refers to "pinging" your website, to let the search engines know your site has been updated. There are a few spammy ones out there, but I would try using:
http://pingomatic.com/
or
https://pingler.com/Pinging is a process by which you can inform major Search Engines and RSS direcotries(Google,Bing,Yahoo,Technorati etc) that you have updated content/URL's in your blog/Website. Pinging can also help in getting website changes indexed quickly.
-
Hi David, did you see Nathon's most recent response? Just checking.
-
Hi David,
Thanks for your response!
Yup, our sitemaps are recreated and resubmitted every day, and those pages have both been fetched (and rendered) in GWT. Not sure exactly what you mean by point 3 though??
-
Even though the 301's are all in place, have you notified Google of the changes? Might be why you are seeing them disappear
1. Sitemap recreation and resubmission
2. Resubmit via Webmaster tools using "fetch as Google"
3. Ping website for new pages
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Spam pages being redirected to 404s but sill indexed
Client had a website that was hacked about a year ago. Hackers went in and added a bunch of spam landing pages for various products. This was before the site had installed an SSL certificate. After the hack, the site was purged of the hacked pages and and SLL certificate was implemented. Part of that process involved setting up a rewrite that redirects http pages to the https versions. The trouble is that the spam pages are still being indexed by Google, even months later. If I do a site: search I still see all of those spam pages come up before most of the key "real" landing pages. The thing is, the listing on the SERP are to the http versions, so they're redirecting to the https version before serving a 404. Is there any way I can fix this without removing the rewrite rule?
Technical SEO | | SearchPros1 -
Switching from HTTP to HTTPS and google webmaster
HI, I've recently moved one of my sites www.thegoldregister.co.uk to https. I'm using wordpress and put in the permanent 301 redirect for all pages to false https for all pages in the htaaccess file. I've updated the settings in google analytics to https for the original site. All seems to be working well. Regarding the google webmaster tools and what needs to be done. I'm very confused by the google documentation on this subject around https. Does all my crawl data and indexing from http site still stand and be inherited by the https version because of the redirects in place. I'm really worried I will lose all of this indexing data, I looked at the "change of address" in the settings of webmaster, but this seems to refer to changing the actual domain name rather than the protocol which i haven't at all. I've also tried adding the https version to the console as well, but the https version is showing a severe warning "is robots.txt blocking some important pages". I don't understand this error as it's the same version and file as the http site being generated by all in one seo pack for wordpress (see below at bottom). The warning is against line 5 saying it will ignore it. What i don't understand is i don't get this error in the webmaster console with the http version which is the same file?? Any help and advice would be much appreciated. Kind regards Steve User-agent: *
Technical SEO | | lqz
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /xmlrpc.php
Crawl-delay: 10 ceLAHIv.jpg0 -
How long after disallowing Googlebot from crawling a domain until those pages drop out of their index?
We recently had Google crawl a version of the site we that we had thought we had disallowed already. We have corrected the issue of them crawling the site, but pages from that version are still appearing in the search results (the version we want them to not index and serve up is our .us domain which should have been blocked to them). My question is this: How long should I expect that domain (the .us we don't want to appear) to stay in their index after disallowing their bot? Is this a matter of days, weeks, or months?
Technical SEO | | TLM0 -
Responsive web design has a crawl error of redirecting to HTTP instead of HTTPS ? is this because of the new update of google that appreciates the HTTPs more?
We at yamsafer.me are using a Repsonsive web design! A crawl errors occured which redirects the hompage to an HTTP version instead of HTTPS? Any ideas on why this happened?
Technical SEO | | Yamsafer.com0 -
Suddenly disappear from google SERP : Pls Help
I am facing too much problems with my all sites and i am afraid with google SERP result. I was penalize by google in previous yea and again Today too. i have a website name is removalinmelbourne.com.au i was happy with my seo because it was coming on the first page and 2nd page with most of the keywords like removalists melbourne, removals melbourne, movers in melbourne, removalists in melbourne and today i was shocked with my result this not showing anywhere on google . Please someone help me . How can i get back .
Technical SEO | | Tufail0 -
Page Title Not Displayed in SERPS
Why would a page title not be displayed in the SERPS? Everything appears to be formatted correctly in the code, yet the title of the company gets displayed instead of the page title? Any general idea why this could be happening?
Technical SEO | | MichaelWeisbaum0 -
Google cached https rather than http
Google is using a secure version of a page (https) that is meant to be displayed using only http. I don't know of any links to the page using https, but want to verify that. I only have 1 secure page on the site and it does not link to the page in question. What is the easiest way to nail down why Google is using the https version?
Technical SEO | | TheDude0 -
Rel canonical or 301 the Index Page?
Still a bit confused on best practice for /index.php showing up as duplicate for www.mysite.com. What do I need to do and How?
Technical SEO | | bozzie3110