Remove internal site SERPS from Google Index?
-
1. Internal Serp pages did not have a robots meta tag
2. As a result, client site has thousands (~4,400) of internal site SERP pages in the Google index.
3. We added the NoIndex, Follow attribute to all internal SERPS
4. We Disallowed: domain.com/internal-search-operator in Robots.txt
5. No new SERP pages are being indexed, but the other 4000 something that were already there are still in the index weeks later.
6. The pages are dynamically created and still work, so I can't use the Remove Content tool from google, because the pages don't 404.
Is there any way to get these pages out of the index besides just waiting and hoping google eventuall drops them?
Thanks
-
You can still submit a url removal request from GWT, because it checks for 1 of 3 things:
- 404 header response code
- NOINDEX meta tag
- Robots.txt disallow rule
So even if its not 404 Google will still do the removal.
-
You can create a formal request to Google using Webmaster Tools and tell them the URLs or list of URLs that you'd like removed from the index. Whether or not they actually remove them is a completely different story.
-
I should have explained it what I meant by SERPS better.
These pages are generated by doing a text search on the site. (Magento) So yes, they are product listings, but obviously most queries are different, so the dynamically created pages are all unique but useless.
Thanks for the idea about rel=canonical them back to the search page - I will look into that.
-
Note: By SERPs I'm assuming you're referring to Search Results within the site (e.g. a product listing) and not actual Google SERPs.
If so, it sounds like it could be a case for canonical. If the pages are all site.com/search.htm?searchterm=xxxx&page=y&rows=100 kind of thing you could canonical them all back down to search.htm.
If you're not familiar with canonical here's a YouMoz post that explains it pretty well:
http://www.seomoz.org/blog/complete-guide-to-rel-canonical-how-to-and-why-not
Based on my experience in the past the canonicalized pages will eventually 'disappear' from the index (not really, but Google doesn't display them anymore) in time. They would also eventually fall out already with what you've done in regards to noindex no follow etc., but I've found it takes longer.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How long does Google take to reduce the index size?
A few months ago, we have incorporated our custom search in our website www.ergodotisi.com . We hadn't been paying a lot of attention to our webmaster analytics, to find out a few months later than the Google Index had grown from 2K- 3K pages to one million because it was crawling all combinations of search filters. We have now followed the right instructions to add noindex meta tags and blocked most search result pages from the robot.txt. We allow indexing of some main categories by setting new seo-friendly url structures. A few weeks have passed and the index size has only reduced to 700K. How long does it take before it removes most of the duplicated search result pages from the index? Is it still crawling those pages but has not fully decided to remove most of them? How bad is this for SEO?
On-Page Optimization | | cplastiras840 -
Do sites with more pages rank better?
If a site has more pages and also has good internal linking, then logically it would rank better. Is this the case? Should I be building big (but high quality) sites?
On-Page Optimization | | T0BY0 -
What are the Best On-Site SEO Practices before an E-commerce Site Goes Live?
Hello, I’m working on a client’s E-commerce website. This website is not live yet. Before the site goes live, I am curious to know what the best practices of On-site SEO are. Please let me know from which factor should I start analyze? Thanks.
On-Page Optimization | | TopLeagueTechnologies0 -
International SEO
We have a client who is looking to expand to other countries, particularly South America. What is my best route forward for SEO on a multi national site?
On-Page Optimization | | CreativeCow0 -
Internal Linking
If i link page A to page B then link page B back to page A would this have less effect than linking page A to page B only? Also are their any good resources for learning internal linking best practise? Thanks in advance.
On-Page Optimization | | Bossandy0 -
Why is this site 1st in Google??
Hello The site www.woodensigns.net is 1st in google for the keyword "wooden Signs". All seo indicators are poor except keyword in url; wich, i thought, was not a + for google anymore. Could someone help me to understand here? Thank you Emmanuel
On-Page Optimization | | manu450 -
Should I Remove This Subdirectory From Google?
On my site, I have a subdirectory. It posts articles from a bunch of websites that my readers are interested in & links back to all of those sites. There is no original content in it. There are over 1700 indexed pages in this subdirectory. The rest of my site has about 500 (all original content). The search engine traffic for this subdirectory only accounts for 3.9% of my sites overall visits. Should I consider removing this subdirectory? Could all the duplicate content be hurting the rankings of my legit pages? What do you all think?
On-Page Optimization | | PedroAndJobu0 -
Best site structure for SEO
Hi, I'm currently in the process of redesigning/rebuilding a well ranking but a dated looking and structured website. Using analytics info I'm trying to put togerther an optimied site map plan for the site based on keywords. Currently the site is structured like this (a few examples) for some of its best ranking keywords / landing pages www.companyname.co.uk/frames/software/companyname-software/keyword/overview.php www.companyname.co.uk/frames/software/companyname-software/keyword/keyword.php I'd like to simplfy this as part of the re build so url's look like this www.companyname.co.uk/companyname-software/softwarecatogry/keyword Obviously I would 201 the old urls. My question is : A. is this a good idea? (From what I've read it is?) B. is there any benifit from having the company name repeated in the url (ie www.companyname.co.uk/companyname-software). My thinking before this is that companyname-software currently ranks well and brings a good amount of traffic. Or should I just go with www.companyname.co.uk/software/softwarecatogry/keyword as opposed to www.companyname.co.uk/companyname-software/softwarecatogry/keyword? Many thanks in advance!
On-Page Optimization | | JamesJacobs0