Thinking about deindexing 200,000 pages
-
So I was hit with Panda and Penguin. Since then I have been trying to figure out what is it that Google is seeing as "low content" on my site along with links. Concerning low content I am a dictionary based site and I have over 200,000 pages which link to sepecific definitions to words like /dictionary/word/a and so on. Most of these pages if not all have a bounce rate of 100% and very little to no traffic. I used to link every word in my database in my site which is where Google got the links from to begin with. Since then I have removed those links with no impact to my rankings, but Google still has them indexed. I am thinking about deindexing all of them from Google. So all my pages with /dictionary/word/[word here] would be removed. Just wanted to get some opinions on that. Maybe a good idea?
Also what would be the preferred method to deindex them.
Robots.txt?
noindex tag?
-
I decided to noindex all the pages, but I brought the links back that point to these pages but added the nofollow attribute as well to all of those. From a Google standpoint these pages are not worth indexing, but for user experience the links are needed.
Thanks
-
How many pages did you deindex?
-
If the pages are there for user experience only, and you dont expect any of these pages to rank, I would block google bot from scanning the pages/categories you want to remove using the robots.txt, as well as making the headers on all these pages no-index (for good measure)
Once you have set this up, you can request the url's to be removed in your G-WMT account.
We had loads of booking pages and media directories indexed, and this is what we did to get them out of the index. Not sure how it improves ranks, but it definitely tells Google which pages are most important preventing Google resources being spent on pages that are not important.
Hope that helps?
Greg
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I earned some high-quality backlinks, but the target page's ranking is not improving. Why?
Within the last three months, I acquired five .EDU backlinks and two editorial links to a page ranking for a competitive keyword. After the first few links came through, the page jumped from #15 to #7. It stayed there with minor fluctuations for a couple weeks. I earned a couple more good links, and the page fell as far as #44. It has recovered a bit then, but has not returned to the first page. It is worth noting that the .EDU links were achieved by sponsoring university programs. Could Google possibly be recognizing this as a link scheme? Are the links being earned too quickly? I don't believe it could be either, as the links reside on high quality, trustworthy sites and there wasn't a sudden major influx of them. Thank you for your insight! Also, I think my username tricked Moz into thinking I'm a staffer. Not the case!
Link Building | | StevenLevine0 -
Second anchor text on page. Does it count?
Back in 2008 there was "proof" that the anchor text of a second link on a page would not be counted for the anchor text.
Link Building | | Stramark
In the MOZ starter guide it is still advocated: https://moz.com/learn/seo/anchor-text BUT in 2014 it was reported on searchengine land:
http://searchengineland.com/googles-matt-cutts-one-page-two-links-page-counted-first-link-192718
That the second link might be counted. Direct link to the matt cuts video from 28 may 2014
https://www.youtube.com/watch?v=5AsLWIuNNMU (Even in 2010 there where already some different opinions and work arounds.
https://moz.com/blog/the-first-link-counts-rule-and-the-hash-sign
https://moz.com/ugc/3-ways-to-avoid-the-first-link-counts-rule (2011) Question: did anyone recently test this recently? The deeper questions are:
1:is the LINK value counted if you have more that one link on a page to another page?
2: is the Anchor text counted if you have more than one anchortext to another page? The most interresting i have is that i have a menu from which i link to my important pages. Does it help to put extra links in the content to specific pages?1 -
Many high value links to printer-friendly versions of our pages
First, forgive me if I miss something obvious. I'm a user experience designer who handles all SEO efforts for our organization in my spare time. This question is about our patient / health education website, http://familydoctor.org NIH's Medline Plus ( http://www.nlm.nih.gov/medlineplus/ ) has linked to http://familydoctor.org for a very, very long time, before we had advertisements on the site. To get an idea of where Medline Plus links to familydoctor.org, visit http://goo.gl/1yaofC or use the following query in Google.com: site:www.nlm.nih.gov inurl:medlineplus American Academy of Family Physicians After we redesigned and started putting ads on FD.org, I think these two things happened simultaneously, we received a contact from someone at NIH stating they could no longer link to our site because of the ads. NIH is a highly-trusted and ranked domain, so we agreed to let them link to the printer-friendly versions of our content to avoid the ads. A few years later, we restructured the content. For an article about depression, instead of having one page with all of the content ( http://web.archive.org/web/20090215071258/http://familydoctor.org/online/famdocen/home/common/mentalhealth/depression/046.html ), we broke it up into many shorter pages ( http://familydoctor.org/familydoctor/en/diseases-conditions/depression.html ), such as Overview, Symptoms, Causes, Diagnosis, Treatment, etc. I don't know if NIH crossed anyone's mind until go-live day, when we noticed a high number of referrals to the error page coming from NIH.gov. We wanted to fix this quickly, so Medline didn't stop linking to us and Google didn't de-value the relationship because of the broken links. We redirected all of the printer-friendly links from the previous site to the printer-friendly whole article (lets you see all the information on one page) on the new site. We did this because there is no way to move between now split up content pages in the split up printer-friendly versions of the site. Even if there was, we didn't think NIH would take too kindly to this. There is a return to the web link on the printer-friendly whole article page. This is a followed link and I realize the anchor text could be improved. We added the following on printer-friendly pages in an effort to not get penalized by search engines for duplicate content. Are we doing all we can to take advantage of these high-value links? Is the meta robots tag necessary, helpful, or not?
Link Building | | aafpitadmin0 -
Links on a search page
On search page (listing products) we may have more than one link for the sameproduct : a link on the title of each product a link on each image's product a link on a "buy" button What is the best practice for this ? Link obfuscation? Do nothing special ?
Link Building | | ouicar1 -
I'm thinking about buying a competitor and 301 redirecting? How much SEO value?
I'm thinking about buying a competitor and 301 redirecting their site to mine. The high level stats are as follows. My site has a DA of 46 and the homepage has a PA of 55. 375 root domains, 170,000 links. The site sells millions of dollars worth of product each year. The competitor (who I had never heard of) has a DA of 58 and a homepage PA of 64. They have 634 root domains and 260,000 links. They aren't selling much of anything (less than 100,000 per year). We might be able to operate their site but I'm concerned about maintaining 2 platforms. My question is about the value of buying this site and 301 redirecting it to my site. Would this create long term SEO value or not? Any examples that have been documented are greatly appreciated.
Link Building | | bradwayland0 -
Link Building for Landing Page
Hey Guys, I have a client that is launching a website in about 2-3 months time. They have had a flash site for the last 4 years and have had no SEO/Link Building to the site and are now going to undertake my services for Content Strategy, Social Strategy and Link Building. In the interim (from now till the next 3 months) they will be launching a "coming soon" landing page. What I want to know is when doing their initial link building do I just concentrate on brand related links through local directories with the aim of getting a few local keyterms? Or should we be deploying a longer term strategy of going after the competitive keyterms now? Thanks,
Link Building | | ecentricmarketing
Michael0 -
We have links from our page at .com and .com/. Should we be concerned about this and try to merge?
When running link reports for our page .com, it redirects to .com/. We do have links for both URLs, but .com/ is significantly more than the other. Should we be concerned by this? Are we losing some links because of this?
Link Building | | hanapin0 -
Getting my crunchbase page to rank in au search engines
Hi, what can I do to make google think this is an Australian page? http://www.crunchbase.com/company/adserve-digital-signage Link to it from .com.au domains?
Link Building | | adam2012
Put my address in on the page as Australia? Is there any other ofpage things that could be done? I would like it to rank for "Digital Signage" Thanks0