Thinking about deindexing 200,000 pages
-
So I was hit with Panda and Penguin. Since then I have been trying to figure out what is it that Google is seeing as "low content" on my site along with links. Concerning low content I am a dictionary based site and I have over 200,000 pages which link to sepecific definitions to words like /dictionary/word/a and so on. Most of these pages if not all have a bounce rate of 100% and very little to no traffic. I used to link every word in my database in my site which is where Google got the links from to begin with. Since then I have removed those links with no impact to my rankings, but Google still has them indexed. I am thinking about deindexing all of them from Google. So all my pages with /dictionary/word/[word here] would be removed. Just wanted to get some opinions on that. Maybe a good idea?
Also what would be the preferred method to deindex them.
Robots.txt?
noindex tag?
-
I decided to noindex all the pages, but I brought the links back that point to these pages but added the nofollow attribute as well to all of those. From a Google standpoint these pages are not worth indexing, but for user experience the links are needed.
Thanks
-
How many pages did you deindex?
-
If the pages are there for user experience only, and you dont expect any of these pages to rank, I would block google bot from scanning the pages/categories you want to remove using the robots.txt, as well as making the headers on all these pages no-index (for good measure)
Once you have set this up, you can request the url's to be removed in your G-WMT account.
We had loads of booking pages and media directories indexed, and this is what we did to get them out of the index. Not sure how it improves ranks, but it definitely tells Google which pages are most important preventing Google resources being spent on pages that are not important.
Hope that helps?
Greg
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google isn't crawling my website page
I have been trying to get indexed my inner page's title tag but still I cannot see this. It has been almost a week. I have done "Fetch as Google" even though I cannot see this. What can be the reason?
Link Building | | ksmith880 -
Page not Ranking I feel helpless!
Hi there 🙂 I have been working at SEO for quite some time and I am such a noob. I have even done an online course. I am at my wits end. My website is https://www.urbani.com.au. I changed to https about 1 month ago. I want to rank for "outdoor furniture perth". Recently my homepage has stopped ranking for this keyword, and a useless blog page started ranking instead (www.urbani.com.au/tag/outdoor-furniture-perth/), on page 5 of google. I got rid of that page and redirected it to my homepage. Do you know what the problem is? Why won't google rank my homepage for "outdoor furniture perth"? It is ranking for "outdoor wicker furniture perth", but for "outdoor furniture perth" it has disappeared from the face of this earth. Thank you so much, if I can get help for this it would save my business! Whitney
Link Building | | vhitnah0 -
Opinions On Resource-Page Linkbuilding
Hi, I'm just looking to get some opinions on resource-page linkbuilding. These are links you would gain from sites when you use the following type of search operators: "keyword" + inurl:links
Link Building | | Tomwindham
"keyword" + inurl:resources
"keyword" + "helpful links"
... and so on... What do you think Google's thoughts on this subject would be when a large portion of the pages returned are long lists of links - usually these will be the title of the page linked to as well as either a bare link or an anchor text link. In some instances a short description of the page linked to would also be there. Are these long-term links that will continue to be relevant and worth spending time on for linkbuilding, or are these going to be see by Google as lower-quality links and potentially unnatural ? For example, Google's page on link schemes states; "Low-quality directory or bookmark site links" may violate their guidelines. Do you think that in some cases, resource pages may be seen as somewhat fitting this description? Thanks! [Edit] I have also found this comment from a Moz post 4 years ago, but cannot find any other reference to John commenting on resource pages: "A while back, someone asked John Mueller in a hangout about the benefits of getting a link on an outdated resource page and the answer was that if it is a link that never gets clicked on then it's probably not passing a lot of value."1 -
Stuck on page 2
I had a site that was ranking for hundreds of keywords, I got hit with a link penalty, got the link penalty removed by creating disavow file, reconsideration request. Last couple of months my site is stuck on page 2 and won't seem to move up. Thoughts?
Link Building | | interstate0 -
Low Page Authority for key landing pages
Hi guys - I am struggling to understand why I have a Page Authority of 1 (!) for most of my key product landing pages. All of them are linked to directly from the Homepage, which has PA 46 and DA 40. Many of them are also linked to from high ranking external sites. Less valuable pages on the site, with far fewer links, seem to have much higher PA. For some reason these just don't seem to be registering the link juice which is flowing to them. In fact, OSE doesn't seem to register any links for them - perhaps this is the biggest clue? I am at a bit of a loss. Some of these pages still rank highly for relevant keywords on Google. But something clearly isn't quite right. Has anyone experienced similar?
Link Building | | HireSpace0 -
Diverse SEO On & Off page questions!
Hey everybody. I have been reading several resources on SEO, and wanted to know your opinion on these topics. I know they are diverse and should be on a different set of questions, but i wanted to give it a try. I run a Heavily Specialized Steel B2B eCommerce Site. So my question would be what is the importance of the following topics, taking into mind the nature of my site. The importance on how often the page is updated ? Recommendations on updating relatively static pages ? How important is to meet HTML and W3C Standards, also its validation. The NoFollow and Follow ratio of incoming links. Your opinion onthe inclusion of outbound links to other relevant pages. Is there a best practice? Any comment is welcome, and would be deeply appreciated. Regards,
Link Building | | JesusD1 -
Tagged pages showing too many links
I'm confused - seo moz crawl shows I have lots of pages with too many links. 150 - 200 or so. I'm not sure how any of my pages can have that many links and they don't appear to to me. Here's an example: http://www.musicliveuk.com/tag/wedding-entertainment They all appear to be 'tag' pages. These pages are blocked by meta robots anyway so is this a problem and how do I fix it? I also am very confused by rel canonical. I have 300 odd pages with this warning. Is this good or bad? Plesae help!
Link Building | | SamCUK0 -
Link Bait - Directory Style Resources Page
Hello Mozzers! Basically I want to add a beefed up "resources" page (directory style) to my site to attract in bound links. Below is an example of a site that has a similar directory style resources area. http://www.petfinder.com/shelters.html I was thinking that it might be good to add a resource box in my site footer with links to these resource pages such as: 1) Dog breeder resources
Link Building | | k9byron
2) Dog training resource
3) Dog shelters/kennels
4) Pet health resources
5) Pet care resources And funnel links to my category pages from there .. I was looking for some feedback or any tips or the best way to go about doing this and if anyone knew of a SE friendly script or something that that I might be able to integrate with my site (x-cart / PHP) platform that would make it easy to populate / update, ect Below is a paste of how one person I talked to envisions it: I'd suggest building some pages of value, such as dog resources pages (rescue groups & resources, etc.), adoption resources, etc. I'd guarantee if the resources were very comprehensive and built correctly, you'd get more bang for the buck versus throwing hundreds (or even thousands) away on sub-par links. Case:
http://www.tnj.com/black-history-makers/major-inventions-african-americans (a simple test content page to show this client we could build lifetime links with a few hours of work for a decent-sized resource page) Although very ugly, this is more of a gold mine for links taking the example above:
http://www.enchantedlearning.com/inventors/black.shtml This is just one simple example but I hope you get the concept versus ongoing payments for junk links.The more links you get to internal pages - even the resource guide pages - the more opportunity to link back to core product pages contextually or within the content portion of the page of side columns. The goal is to create funneled links from these resource pages back to your other pages, but doing it in a manner that's not outlandish or spammy in nature.0