Remove internal site SERPS from Google Index?
-
1. Internal Serp pages did not have a robots meta tag
2. As a result, client site has thousands (~4,400) of internal site SERP pages in the Google index.
3. We added the NoIndex, Follow attribute to all internal SERPS
4. We Disallowed: domain.com/internal-search-operator in Robots.txt
5. No new SERP pages are being indexed, but the other 4000 something that were already there are still in the index weeks later.
6. The pages are dynamically created and still work, so I can't use the Remove Content tool from google, because the pages don't 404.
Is there any way to get these pages out of the index besides just waiting and hoping google eventuall drops them?
Thanks
-
You can still submit a url removal request from GWT, because it checks for 1 of 3 things:
- 404 header response code
- NOINDEX meta tag
- Robots.txt disallow rule
So even if its not 404 Google will still do the removal.
-
You can create a formal request to Google using Webmaster Tools and tell them the URLs or list of URLs that you'd like removed from the index. Whether or not they actually remove them is a completely different story.
-
I should have explained it what I meant by SERPS better.
These pages are generated by doing a text search on the site. (Magento) So yes, they are product listings, but obviously most queries are different, so the dynamically created pages are all unique but useless.
Thanks for the idea about rel=canonical them back to the search page - I will look into that.
-
Note: By SERPs I'm assuming you're referring to Search Results within the site (e.g. a product listing) and not actual Google SERPs.
If so, it sounds like it could be a case for canonical. If the pages are all site.com/search.htm?searchterm=xxxx&page=y&rows=100 kind of thing you could canonical them all back down to search.htm.
If you're not familiar with canonical here's a YouMoz post that explains it pretty well:
http://www.seomoz.org/blog/complete-guide-to-rel-canonical-how-to-and-why-not
Based on my experience in the past the canonicalized pages will eventually 'disappear' from the index (not really, but Google doesn't display them anymore) in time. They would also eventually fall out already with what you've done in regards to noindex no follow etc., but I've found it takes longer.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is there a benefit to hiding words from Google on ecommerce sites?
I think we all know that ecommerce sites have a lot of repeating functional texts on them. Is there a benefit from hiding this text from Google's crawler? Take this page for example, http://storage3.static.itmages.com/i/16/0805/h_1470425505_1090542_224cc344d4.png Some of the most dense words on the page are "Add to cart", "Add to Wishlist", "New", and "Sale". Is there any benefit to hiding those words from Google? The method of hiding I am talking about is not cloaking, but this, https://www.google.com/support/enterprise/static/gsa/docs/admin/70/gsa_doc_set/admin_crawl/preparing.html#1076243 using the google:off index tag. So the content will be there still, but it will not be indexed.
On-Page Optimization | | LesleyPaone0 -
Do Google Know What People Are Doing On My Site?
I run an ecommerce site and am keep to increase the time on site and reduce bounce rate. I have had some good results from writing good articles and advertising them on Outbrain and Twitter; both of these metrics have improved. However, I am wondering if Google will see this. Clearly if people land on the pages from the SERPS and return there they will know what is happening but will they know if people get there from an advert?
On-Page Optimization | | T0BY0 -
Is Google indexing something I can't see on my page title?
When I do a search for my businesses website (colourpages.com) it returns a listing which is great but the title tag includes Hull Colour Pages which is our old brand name - we changed to colourpages.com 2 years ago yet Hull Colour Pages is still pulling through on the title tag. I have checked the source and it's as follows: <title>Plumbers in Hull - Reviews - colourpages.com</title> I have attached a photo which shows the issue - http://imgur.com/Cva3001 Is Google indexing it from old history that is no longer visible or am I missing something? Cva3001
On-Page Optimization | | colourpages0 -
SEO for New Magento Site??!?
Hi All, We have had a new site delivered by our developers (hurrah...the old one was to terrible for words) but we seem to be having a lot of issues with the new Magento platform. What they have done is used the community version and tried to customize it. I came on to this project about a month into the build and although Magento does seem to do a lot things well there do seem to be some problems. From an SEO prespective we have seen some increase on some search terms and a drop of in others. I would be interested in hearing from other Magento users about their experiences with this platform and any ideas on how to crank up the activity. Our site is at www.nationwidepharmacies.co.uk . There are few odd bits including the side navigation which seems to be very clunky and not overly customizable in this version. Any useful criticism would also be well received. Look forward to hearing Nic
On-Page Optimization | | nicc19760 -
Index.php + external site added to end of URL
Good day, I have a domain http://www.ecofriendlylink.com. I am trying to resolve the Crawl Diagnostic errors on it. I have several Duplicate Page Content errors. Example 1: (The domain happynewyou is not mine, some Comments from them have been placed on my site. Ecoshop.php is a page on my site). URL: http://www.ecofriendlylink.com Duplicate Page Content: http://www.ecofriendlylink.com/www./happynewyou.com/ecoshop.php Referrer: None. Example 2: URL: http://ecofriendlylink.com/index.php Duplicate Page Content: http://www.ecofriendlylink.com/index.php http://www.ecofriendlylink.com/www./happynewyou.com/index.php Referrer: http://ecofriendlylink.com/ Example 3: is a different problem, but still a Dup Page Error. URL: http://ecofriendlylink.com/water.php Duplicate Page Content: http://www.ecofriendlylink.com/water.php Referrer: http://ecofriendlylink.com/ water.php is a page on my main domain. The www version and the non-www version, if this a problem and something I need to overcome? So please can you advise what I need to do to get rid of this strange external domain name + index.php (as per examples 1 + 2), and explain what I'm doing wrong with Ex 3. Thank you!
On-Page Optimization | | drkevinhogan0 -
Site Structure
I'm confused about the best way for seo to set up the site structure . i understand the examples of the pyramid diagrams and how link juice flows, however does this mean that global navigation is not good? It appears the pyramid structure leads to the designated number of category pages (we'll use five) and they lead to the 5 content pages etc and some "superman pages" can be linked to from the home page but is this is global navigation or anchor text navigation and is gloval navigation acdeptable for content pages? Any input would be greatly appreciated. Thank you.
On-Page Optimization | | JulB0 -
Date stamp in serp
I have a website with sauna reviews. These are mostly pages that exist for years and regularly change because comments/reviews are added by visitors and/or because I change information on the page. When searching in Google for competitive keywords I noticed that the snippet of my direct competitor included a date stamp in the format (9 hous ago). How can I include a time stamp in the snippet, and more important how can I make sure that the timestamp is very recent. Is it sufficient to add a date on the page every time the page is updated or is ther emore to it?
On-Page Optimization | | oeroek0 -
Page Indexing
Hello All Nice easy question! I've made some on page changes to page titles, content, H1s etc but wanted to know if there was a way to check if Google has reindexed the page since the changes were made? I appreciate the different factors that will help improve your crawl rate like new content, external links, domain authority etc. I made these changes around 2 weeks ago. Google has cached the pages since I made the changes but not picked up on the new page titles in the search results. Cheers Todd
On-Page Optimization | | todd75850