Google dropping pages from SERPS
-
The website for my London based plumbing company has thousands of specifically tailored pages for the various services we provide to all the areas in London. It equates to approximately 6000 pages in total.
When google has all these pages indexed, we tend to get a fair bit of traffic - as they cater pretty well for long tail searches. However, every once in a while Google will drop the vast majority of our indexed pages from SERPs for a few days or weeks at a time - for example at the moment Google is only indexing 613 whereas last week it was back at the normal ~6000.
Why does this happen? We of course lose a lot of organic traffic when these pages don't displayed - what are we doing wrong?
Website: www.pgs-plumbers.co.uk
-
I am fairly sure that Pagerank is now constantly updated, it may well be that they only adjust the visible pagerank every three months though.
I can only say this next bit speculatively because I don't have the data (I would love to see the periods and numbers for the site above), but the cap itself might be a somewhat fluid idea, pages may be retained in the index as they are discovered but get pared back to their "hard cap" periodically.
-
Yeah, good shout. I was thinking about that as well, and maybe something to do with switching or upgrading of data centers, but probably not the latter to this extent.
-
Seems unlikely he would drop 90% of indexed pages and regain them back soon after if it was a PR thing, don't you think? Aren't PR updates generally quarterly?
-
I think it could be down to an indexation cap. I know Pagerank is not the force it once was but it does play a role in the number of pages google retains in it's index (if they regularly cull sites back to their cap that might explain the fluctuation, or maybe you fluctuate between two thresholds).
Matt Cutts made some comments which Rand broke down into bitesize chunks in the SEOmoz blog to that effect:
http://www.seomoz.org/blog/an-illustrated-guide-to-matt-cutts-comments-on-crawling-indexation
Your Pagerank is low, and without trawling through your site I don't know about duplicate content, but this could well be it. The fix is the same as an awful lot of SEO problems, more, better links.
-
I also think it's very possible his previous experiences with rankings dropping and pages getting de-indexed could have been at key algo udpates as well. Mayday, etc...
-
Yup David's point above is the prime suspect for a lot of changes just now, however you say this has happened before?
Are you doing anything else at the times when you've noticed you get dropped for a few days/weeks? Roughly how often does it happen?
EDIT - Just quickly put your site into OSE and you don't have a hugely diverse link profile, plus the sort of sites you're getting links from may have been effected by the farmer update which is had a knock on effect to your site (and similar updates may have done in the past). Not conclusive but something to think about as well.
-
The answer could easily be the Google Farmer update. If you are not familiar with this, read the latest post by Rand: http://www.seomoz.org/blog/googles-farmer-update-analysis-of-winners-vs-losers
That will help you understand the latest algorithm update and how you can do something about it.
It sounds like you dropped off due to the algo update and that leads me to believe that Google thought your content was not high enough quality?
I would read Rand's post, evaluate your website, and then have the content analyzed and see if you need to hire a really good writer to build high quality content that is valuable to the users. If you were building mediocre content to target thousands of keywords, specifically long-tail, you need to revamp that strategy and focus on amazing content first!
Hope that helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Sudden issue: no google cache for any product detail pages and offer schema missing from SERPS
Absolutely no idea what is going on. All of our category / subcategory and other support pages are indexed and cached as normal, but suddenly none of our product pages are cached, and all of the product / offer schema snippets have been dropped from the serps as well (price, review count, average rating etc). When I inspect a product detail page url in GSC, I am either getting errors or it is returned as a soft 404. There have been no recent changes to our website that are obvious culprits. When I request indexing, it works fine for non-product pages, but generates the "Something went wrong
Technical SEO | | jamestown
If the issue persists, try again in a few hours" message for any product page submitted. We are not SEO novices. This is an Angular 7 site with a Universal version launched back in October (new site, same domain), and until this strange issue cropped up we'd enjoyed steady improvement of rankings and GSC technical issues. Has anyone seen anything like this? We are seeing rapid deterioration in rankings overnight for all product detail pages due to this issue. A term / page combination that ranked for over a decade in the top 10 lost 10 places overnight... There's just no obvious culprit. Using chrome dev tools to view as googlebot, everything is kosher. No weird redirects, no errors, returns 200 and page loads. Thank You0 -
Use Internal Search pages as Landing Pages?
Hi all Just a general discussion question about Internal Search pages and using them for SEO. I've been looking to "noindexing / follow" them, but a lot of the Search pages are actually driving significant traffic & revenue. I've over 9,000 search pages indexed that I was going to remove, but after reading this article (https://www.oncrawl.com/technical-seo/seo-internal-search-results/) I was wondering if any of you guys have had success using these pages for SEO, like with using auto-generated content. Or any success stories about using the "noindexing / follow"" too. Thanks!
Technical SEO | | Frankie-BTDublin0 -
Is there a way to get a list of all pages of your website that are indexed in Google?
I am trying to put together a comprehensive list of all pages that are indexed in Google and have differing opinions on how to do this.
Technical SEO | | SpodekandCo0 -
How to get google to forget my old but still working page and list my new fully optimized page for a keyword?
Hi There! (i am beginner in seo) I have dynamic and static pages on our site. I created a static page for a specific keyword. Fully optimized it, (h1, alt, metas, etc.....maybe too optimized). My problem is that this page is alive for weeks, checked it in GWT and it is in robots.txt, google sees it, and indexed it. BUT whenewer i do a search for that keyword, we still appear with the dynamically created link in the google listings. How could i "redirect" google, if sy make a search for that keyword than shows our optimized page? Is there a tool for that? I cant delete the dynamic page... Any ideas? Thx Andrew
Technical SEO | | Neckermann0 -
How to check if an individual page is indexed by Google?
So my understanding is that you can use site: [page url without http] to check if a page is indexed by Google, is this 100% reliable though? Just recently Ive worked on a few pages that have not shown up when Ive checked them using site: but they do show up when using info: and also show their cached versions, also the rest of the site and pages above it (the url I was checking was quite deep) are indexed just fine. What does this mean? thank you p.s I do not have WMT or GA access for these sites
Technical SEO | | linklander0 -
Test site got indexed in Google - What's the best way of getting the pages removed from the SERP's?
Hi Mozzers, I'd like your feedback on the following: the test/development domain where our sitebuilder works on got indexed, despite all warnings and advice. The content on these pages is in active use by our new site. Thus to prevent duplicate content penalties we have put a noindex in our robots.txt. However off course the pages are currently visible in the SERP's. What's the best way of dealing with this? I did not find related questions although I think this is a mistake that is often made. Perhaps the answer will also be relevant for others beside me. Thank you in advance, greetings, Folko
Technical SEO | | Yarden_Uitvaartorganisatie0 -
Cached pages still showing on Google
We noticed our QA site showing up on Google so we blocked them in our robot.txt file. We still had an issue with them crawling it so we blocked the site from the public. Now Google is still showing a cached version from the first week in March. Do we just have to wait until they try to re-crawl the site to clear this out or is there a better way to try and get these pages removed from results?
Technical SEO | | aspenchicago0 -
Keywords Ranking Dropped from 1st Page to Above 5th Page
Hello, My site URL is http://bit.ly/161NeE and our site was ranked first page for over hundred keywords before March, 30. But all of a sudden, all the keywords on first page dropped to 5th or 6th page. When we search for our site name without ".com", the results appeared on first page are all from other sites. And our page can only be seen on 6th page. We think we have been penalized by Google. But we don't know the exact reason. Can anyone please help? Some extra info on our site: 1. We have been building links by posting blog, articles and PR. All the articles are unique, written by the writers we hire. It has been working fine all the time. We also varied the anchor text a lot. 2. We didn't make any change to the website. But one real problem with our site is that the server is very slow recently and when google crawl our website, many errors were found, mostly 503, 404 errors. And the total number of errors have reach to over 50,000. Do you think this might be a problem for Google not displaying us on first page? Our technicals are working hard to solve server problem. And if it is solved, shall our rankings be back? Please advise. Thanks.
Technical SEO | | Milanoocom0