How long does Google take to reduce the index size?
-
A few months ago, we have incorporated our custom search in our website www.ergodotisi.com . We hadn't been paying a lot of attention to our webmaster analytics, to find out a few months later than the Google Index had grown from 2K- 3K pages to one million because it was crawling all combinations of search filters. We have now followed the right instructions to add noindex meta tags and blocked most search result pages from the robot.txt. We allow indexing of some main categories by setting new seo-friendly url structures. A few weeks have passed and the index size has only reduced to 700K. How long does it take before it removes most of the duplicated search result pages from the index? Is it still crawling those pages but has not fully decided to remove most of them? How bad is this for SEO?
-
How long does it take before it removes most of the duplicated search result pages from the index?
Every site is different but I have seen it take 6 - 9 months for pages to drop out.
Is it still crawling those pages but has not fully decided to remove most of them?
It's possible. As Gaston has already pointed out, search engines will need to access those files again to see you want them noindexed.
How bad is this for SEO?
It temporarily dilutes the amount of SEO equity available to flow to pages you DO want indexed.
-
Hello there,
Did you left some time, without blocking those pages, to google bot to recrawl them?
If you implemented at the same time the noindex tag and the disallow in the robots.txt you are not letting google know that those pages should be deindexed.
Remember that blocking pages in the robots.txt avoid to be scanned again and the new robots tag is not seeng by google bot.My advise is to let google bot recrawl all those pages and wait a few days, may be 2-3 weeks. Slowly the amount of indexed pages will decrease.
Hope i've helped.
Best luck.
GR.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why my website some pages is not index in google ?
Hi, I have submitted my pages in Google fetch for consideration tool but they are not indexed yet in the Google search. Additionally, there is also no error shown by the Google.
On-Page Optimization | | seo.kishore890 -
Meta Titles On Site Different From Google Index Page
This is very embarrassing but I hope someone can help. The Meta Titles on my site are not being shown correctly on the Google site index. For example, when I got directly to the page the appropriate page title is shown obviously. However when I go view that page on Google, the title in completely different. Page title: <a class="attribute-value">Web Design, SEO, PPC, Mobile Development In Philadelphia, Bucks| Infinity Digital Agency</a> Google Shows: Our Services - Infinity Digital Agency Here is the result page. I am currently running WordPress and Yoast. Any thoughts would be greatly appreciated. https://www.google.com/search?q=site%3Awww.infinitydigitalagency.com%2Fservices%2F&ie=utf-8&oe=utf-8
On-Page Optimization | | infinitydigitalagency0 -
How long should I leave an existing web page up after a 301 redirect?
I've been reading through a few of blog posts here on moz and can't seem to find the answer to these two questions: How long should I leave an existing page up after a 301 redirect? The page old page is no longer needed but has pretty high page authority. If I take the old page down—the one that I'm redirecting from—immediately after I set up the 301 redirect, will link juice still be passed to the new page? My second question is, right now, on my index.html page I have both a 301 redirect and a rel canonical tag in the head. They were both put in place to redirect and pass link equity respectively. I did this a couple years back after someone recommended that I do both just to be safe, but from what I've gathered reading the articles here on moz is that your supposed to pick one or the other depending on whether or not it's permanent. Should I remove the rel conanical tag or would it be better to just leave it be?
On-Page Optimization | | ScottMcPherson0 -
Strange ranking occurrences in Google (NL)
Mozzers, I got a question for all of you. Recently (about 3 months ago) I launched a renewed website for a costumer of mine. Since then rankings have been improving and some decreasing a little but overall it went quite allright. _Still, we now have some issues with some new pages and I really don't know what to do any more. _ The Case:
On-Page Optimization | | JarnoNijzing
For starters lets say the company sells vacuum cleaners. We now make pages for specific product ranges e.g. Miele Diamond vacuum cleaners which in turn tells something about this product range and has links to different pages of that series, for instance the Miele Black Diamond Silent Vacuum Cleaner. Why did we do this? We already ranked for specific product pages but also wanted to rank for more general terms and thus product ranges. What happened? We now rank perfectly well for the product pages itself but for some reason the Miele Diamond Vacuum Cleaners page doesn't rank at all or not as it should. Why is this strange? Because we applied the exact same tactic for some other product ranges on the same website and it worked like a charm (part of the reason why we started to do this for all product-ranges). I could really use some help here. If you want I can message you the pagelink in PM but I won't post it here for several reasons. The Vacuum Cleaners in this example or not the real products though but used as an exemplar. I really do hope to hear from you with some advice or request for more information. Regards
Jarno0 -
I have seen zero movement in my Google keyword rankings.
I have seen zero movement in my Google keyword rankings, but I have seen movement on the other search engines. I must be doing something wrong. Any tips?
On-Page Optimization | | LindaWolfe0 -
Website Changes Updated in Google...
How long does it take for Google to recognize SEO changes that I have made to my website?
On-Page Optimization | | AubbiefromAubenRealty0 -
FAQS For Seo & Long Tail Optimization
Would it be ok to create a small FAQ section on the particular page I am working on using long tail keywords, all which have low competition, high search volume? I see a few competitors ranking this way, but it does not flow, its very obvious they are stuffing. Thanks!
On-Page Optimization | | TP_Marketing0 -
Google indexing Internal Search Results
Greeting, Currently I have noticed that Google is starting to index our internal search page results. Should I block those pages in our robot txt file or have you ever heard of any websites that actually gained traffic or rank by letting Google index those pages? Thanks
On-Page Optimization | | Tonyd230