How long does Google take to reduce the index size?
-
A few months ago, we have incorporated our custom search in our website www.ergodotisi.com . We hadn't been paying a lot of attention to our webmaster analytics, to find out a few months later than the Google Index had grown from 2K- 3K pages to one million because it was crawling all combinations of search filters. We have now followed the right instructions to add noindex meta tags and blocked most search result pages from the robot.txt. We allow indexing of some main categories by setting new seo-friendly url structures. A few weeks have passed and the index size has only reduced to 700K. How long does it take before it removes most of the duplicated search result pages from the index? Is it still crawling those pages but has not fully decided to remove most of them? How bad is this for SEO?
-
How long does it take before it removes most of the duplicated search result pages from the index?
Every site is different but I have seen it take 6 - 9 months for pages to drop out.
Is it still crawling those pages but has not fully decided to remove most of them?
It's possible. As Gaston has already pointed out, search engines will need to access those files again to see you want them noindexed.
How bad is this for SEO?
It temporarily dilutes the amount of SEO equity available to flow to pages you DO want indexed.
-
Hello there,
Did you left some time, without blocking those pages, to google bot to recrawl them?
If you implemented at the same time the noindex tag and the disallow in the robots.txt you are not letting google know that those pages should be deindexed.
Remember that blocking pages in the robots.txt avoid to be scanned again and the new robots tag is not seeng by google bot.My advise is to let google bot recrawl all those pages and wait a few days, may be 2-3 weeks. Slowly the amount of indexed pages will decrease.
Hope i've helped.
Best luck.
GR.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to NOT keyword stuff in long form content
My homepage has an authoritative guide with long form content. As a result, my main keyword is mentioned 40+ times. It's not forced, but natural, and the frequency of it is a function of the length of the article. Is that okay? Any suggestions or advise?
On-Page Optimization | | ntaparia171 -
Google search returns blog homepage, but not article
When I do a google search for a specific article on our blog the search results only return the blog homepage with the article title shown in the meta description, but never the actual article page. I've tried to refine my search by using site: and quotation marks around the article title (e.g site:www.example.com "article title") but still only get the homepage. Our blog is showing up so I assume it's not an indexing issue, but not sure how to get the article pages to show on serps. Any ideas? Thanks!
On-Page Optimization | | STP_SEO0 -
Google Page Rank has no any rankings as of now. what to do?
my domain and page authority is working well right now but my Google Page Rank has no any rankings as we speak. What to do now? can some of you give me advice on this? Thank you very much in advance.
On-Page Optimization | | Panoramictrip0 -
Google Is Ranking the Wrong Page
Howdy Folks- I have a case where Google is ranking the wrong page for a couple of different keywords. The home page is: http://healthtn.com Most notably, we're trying to optimize the home page for "Tennessee Health Insurance" but the below page is what continually ranks for it, and does so very poorly. We used to be page two with the home page, now we are page four and it ranks the following page. http://healthtn.com/tennessee/health-insurance/student I have started directing our Internal Linking to reflect the correct anchor text but succeeded in losing ranking for the term, but am still ranking the wrong page. Any thoughts or help would be much appreciated!
On-Page Optimization | | CRO_first0 -
Google is NOT showing up the right META DESCRIPTION
Hi, Recently I changed titles and meta descriptions of some pages. The problem is that google have updated the titles but not the meta descriptions.. Ive also checekd the source code of the google cached version of the pages crawled and the meta description reflect the changes i did...but the changes don't appear in google. Do you have some solution/advice for the issue? Tx so Much
On-Page Optimization | | tourtravel0 -
Will Google penalise me for duplicating my own website on a new domain?
Hi guys, Currently, we are using Magento Enterprise to run two separate ecommerce websites, for arguments sake lets say these two websites are ElectronicsX.com and electronicsY.co.uk. ElectronicsX.com isn't doing too well, it has little traffic, makes next to nothing each month and is just a waste of resources. ElectronicsY.co.uk on the other hand is getting 30,000 unique visits every month and is over exceeding every month in terms of revenue in sales. At the moment, the only traffic we get from Europe tends to be the odd "word of mouth" customer and English customers who have emigrated to Europe but still like to use English companies. We can't rank on Google FR or ES or anything like that because the website we have "electronicsY" is on a .co.uk TLD (a GeoTLD). So what we want to do is take ALL the content from electronicsY.co.uk and place it on electronicsX.com so that we can start targeting Europe and ranking in the serps internationally. What sort of effect will that have in terms of penalisation from Google? Or because the websites are on the same C block, would it have any effect at all? Thanks guys Tom
On-Page Optimization | | tomhall900 -
No index?
Hi, I have about 600 posts and most of them are not really optimized (some of them are flash photo gallery). Should I do no index them? They are just too many to optimize them. My website is http://www.soobumimphotography.com/ Thank you
On-Page Optimization | | BistosAmerica0 -
Possible Reasons for 40% Drop in Google since January?
Hello: I know this is long - but I kept it as succinct as I could to explain the situation - but everyone of the brilliant people on here insight is so greatly appreciated in advance. There has been more than a 30% decline in traffic mostly from Google on a site with an 11 year presence on the web, 5 page rank (historically 6), fairly good quality backlinks (but they are old). I cannot pinpoint a smoking gun (such as a specific penalty) - if it's just not attrition in demand for the product itself which there is plenty of evidence for. But I practice only white hat, so I don't know what it is. I do not engage right now in link building because my time to work on SEO is very limited. We have a few common keywords that cannot be avoided (because there are no good synonyms) so there is a high density for one word especially all over the site. From some websites (like tidbits) we have in Google Webmaster account tens of thousands of backlinks. How serious is this (FYI - they're not new though) Because of some unflattering reviews from sites with strong authority, the number of click throughs vs. impression in Google Search has dropped dramatically - I think a big part of it is that because the reviews drove down CT ratio. Interestingly, the number of CTs from Adwords has also dropped off significantly, and I was told by Adwords specialist that declining organic traffic does affect the Adwords traffic to - in fact, they're not even using our daily budget for Adwords as they used to. The site also doesn't pick up quality organic backlinks as it used to, and the anchor link text is almost always the same - a product name. Plus, the site was banned in 2008 by Google (from a black hat keyword stuffing that I discovered happened in another dept.) and only after really working hard was it reinstated by reconsideration request. Site traffic from Google has never fully reached it's potential since then. Also, text prices were removed from Buy Now buttons even though the prices were textually part of the buttons for years (could this be some penalty?) **Is it possible that Google is taking the ban history, the poor reviews, the decline in CTs to impressions on the site, the huge decline (75% over four years) in "search volume" or "search interest" (according to Google Trends) for the site's main product name and just using all of this to keep downgrading the site? If true, wouldn't the page rank be diving down to anywhere from 0 to 2 (or is that not relevant at all?) ** There are no messages of a penalty or anything else in the official Webmaster account for this site. Any insight anyone is able to provide is much appreciated.
On-Page Optimization | | holdtheonion1