Remove internal site SERPS from Google Index?
-
1. Internal Serp pages did not have a robots meta tag
2. As a result, client site has thousands (~4,400) of internal site SERP pages in the Google index.
3. We added the NoIndex, Follow attribute to all internal SERPS
4. We Disallowed: domain.com/internal-search-operator in Robots.txt
5. No new SERP pages are being indexed, but the other 4000 something that were already there are still in the index weeks later.
6. The pages are dynamically created and still work, so I can't use the Remove Content tool from google, because the pages don't 404.
Is there any way to get these pages out of the index besides just waiting and hoping google eventuall drops them?
Thanks
-
You can still submit a url removal request from GWT, because it checks for 1 of 3 things:
- 404 header response code
- NOINDEX meta tag
- Robots.txt disallow rule
So even if its not 404 Google will still do the removal.
-
You can create a formal request to Google using Webmaster Tools and tell them the URLs or list of URLs that you'd like removed from the index. Whether or not they actually remove them is a completely different story.
-
I should have explained it what I meant by SERPS better.
These pages are generated by doing a text search on the site. (Magento) So yes, they are product listings, but obviously most queries are different, so the dynamically created pages are all unique but useless.
Thanks for the idea about rel=canonical them back to the search page - I will look into that.
-
Note: By SERPs I'm assuming you're referring to Search Results within the site (e.g. a product listing) and not actual Google SERPs.
If so, it sounds like it could be a case for canonical. If the pages are all site.com/search.htm?searchterm=xxxx&page=y&rows=100 kind of thing you could canonical them all back down to search.htm.
If you're not familiar with canonical here's a YouMoz post that explains it pretty well:
http://www.seomoz.org/blog/complete-guide-to-rel-canonical-how-to-and-why-not
Based on my experience in the past the canonicalized pages will eventually 'disappear' from the index (not really, but Google doesn't display them anymore) in time. They would also eventually fall out already with what you've done in regards to noindex no follow etc., but I've found it takes longer.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Answer Box
I optimized several pages using Rand's post on Google Answer Box: https://moz.com/blog/how-to-appear-in-googles-answer-boxes-whiteboard-friday How long after the page is indexed should it appear? Lastly, how long should I wait before determining it will not get an answer box and reconfigure the page? No bad answers 🙂 TY KJr
On-Page Optimization | | KevnJr0 -
Is this still considered true about INTERNAL anchor text? "Penguin seems to be targeting overly aggressive anchor text (both internally and externally), especially from low-quality sources."
Recently I've heard a few people say now it's okay to be aggressive with internal linking. So a link from mydomain.com/news to mydomain/widgets can use spammy anchor text like "best green widgets in California" that are an obvious problem for links coming in from external site. Which is accurate?
On-Page Optimization | | corlin0 -
Do sites built with WordPress work in China get indexed by Baidu?
I think that WordPress.com is banned, but are websites that are created by WordPress get banned?
On-Page Optimization | | CoGri0 -
Google index text that I can not find
Hello everybody, As you can see here: http://webcache.googleusercontent.com/search?q=cache:G-iicHoDJeYJ:www.billigste-internet.dk/&hl=da&gl=dk&strip=1 Google index the text "Forside" as the H1 tag, and "Right" and "Left" as body text, on my website. But I do not want that Google indexes this. But when I look in mine source code (see here: view-source:http://www.billigste-internet.dk/) I can not find "Forside", "rigth" or "Left", so I can delete it. Is there anyone who can help me where I need to delete the text "Forside", "Right" and "Left", so Google does not index this text? Hope someone can help.
On-Page Optimization | | JoLindahl910 -
Site: command and intitle: command in Google changed?
Hi Mozzers, I'm seeing some changes in Google when using certain commands I've used for ages. I'm trying to spot cananical issues by using this search site:www.mysite.com intitle:"keyword" This used to list all pages in the index on a certain site with the keyword in the title. Now I'm getting weird results and sometimes results from other sites - not the one specified in the site: command. Anyone else seeing this? Thanks B
On-Page Optimization | | Bush_JSM0 -
No Follow Internal Links
Hi Mozzers, I know that this has been asked a few times and answered as well, I would just like to know some more on the internal link count on a page. I ran the SEOmoz report and many of the pages on the website have more than 150+ internal links. Now, should I use the rel=nofollow tag on some pages that I feel are not important? I have a list of pages which are not important from the SEO point of view, but from the usability factors they need to be there so I cannot remove the links to them. So, would be OK to place the rel=nofollow tag on them. My whole purpose is to reduce the count of internal links on the page as seen by SE's. Now, some say that the rel=nofollow tag does not lower the link count, but it can definitely (I believe) prevent the bots time in getting to those pages, which SEOmoz report also quotes. (__When search engine spiders crawl the Internet they are limited by technology resources and are only able to crawl a certain number of links per webpage. ) So, probably I can save their time. Does anyone have any views on this, Cheers,
On-Page Optimization | | RanjeetP0 -
I think I`ve caught some kind of google filter on my site.
What if the PA and the DA on my domain and the entire site is 1. Most of the pages on the site were empty or not unique. Now I`m adding new pages with unique content. I have only one position in the top 10. The remaining 15 positions are above the top. What should I do to increase my PA & DA and to have top 10 positions by other keywords?
On-Page Optimization | | ATCnik0