Thinking about deindexing 200,000 pages
-
So I was hit with Panda and Penguin. Since then I have been trying to figure out what is it that Google is seeing as "low content" on my site along with links. Concerning low content I am a dictionary based site and I have over 200,000 pages which link to sepecific definitions to words like /dictionary/word/a and so on. Most of these pages if not all have a bounce rate of 100% and very little to no traffic. I used to link every word in my database in my site which is where Google got the links from to begin with. Since then I have removed those links with no impact to my rankings, but Google still has them indexed. I am thinking about deindexing all of them from Google. So all my pages with /dictionary/word/[word here] would be removed. Just wanted to get some opinions on that. Maybe a good idea?
Also what would be the preferred method to deindex them.
Robots.txt?
noindex tag?
-
I decided to noindex all the pages, but I brought the links back that point to these pages but added the nofollow attribute as well to all of those. From a Google standpoint these pages are not worth indexing, but for user experience the links are needed.
Thanks
-
How many pages did you deindex?
-
If the pages are there for user experience only, and you dont expect any of these pages to rank, I would block google bot from scanning the pages/categories you want to remove using the robots.txt, as well as making the headers on all these pages no-index (for good measure)
Once you have set this up, you can request the url's to be removed in your G-WMT account.
We had loads of booking pages and media directories indexed, and this is what we did to get them out of the index. Not sure how it improves ranks, but it definitely tells Google which pages are most important preventing Google resources being spent on pages that are not important.
Hope that helps?
Greg
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I earned some high-quality backlinks, but the target page's ranking is not improving. Why?
Within the last three months, I acquired five .EDU backlinks and two editorial links to a page ranking for a competitive keyword. After the first few links came through, the page jumped from #15 to #7. It stayed there with minor fluctuations for a couple weeks. I earned a couple more good links, and the page fell as far as #44. It has recovered a bit then, but has not returned to the first page. It is worth noting that the .EDU links were achieved by sponsoring university programs. Could Google possibly be recognizing this as a link scheme? Are the links being earned too quickly? I don't believe it could be either, as the links reside on high quality, trustworthy sites and there wasn't a sudden major influx of them. Thank you for your insight! Also, I think my username tricked Moz into thinking I'm a staffer. Not the case!
Link Building | | StevenLevine0 -
Inbound Links from Broken Pages
Hi all, We have a client who has a lot of inbound links from external pages that are broken/404. The 404 pages are EXTERNAL and linking to my client's pages, but their domain still has authority and their home page (and other pages) still load. My question is: what should we do about this? Do we detox those links, or are they still sending some juice given that they have domain authority, despite the fact that the pages linking to my client are broken? So in other words: - My client is: yyyy.com - They have a link from vvvv.com/services, which is a broken page - So what should we do about this? Thanks all! Gavin
Link Building | | strategemilabs0 -
Updating old dated pages or making new ones?
Hey All, I'm working on a project that relies on deals with specific dates like a fair or rodeo. However, fairs happen every year during the same time. I'm not sure if I should delete the old ones or updated them with new information. What do you suggest?
Link Building | | CobraJones950 -
Diverse SEO On & Off page questions!
Hey everybody. I have been reading several resources on SEO, and wanted to know your opinion on these topics. I know they are diverse and should be on a different set of questions, but i wanted to give it a try. I run a Heavily Specialized Steel B2B eCommerce Site. So my question would be what is the importance of the following topics, taking into mind the nature of my site. The importance on how often the page is updated ? Recommendations on updating relatively static pages ? How important is to meet HTML and W3C Standards, also its validation. The NoFollow and Follow ratio of incoming links. Your opinion onthe inclusion of outbound links to other relevant pages. Is there a best practice? Any comment is welcome, and would be deeply appreciated. Regards,
Link Building | | JesusD1 -
#1 with grade F page optimization
For a specific keyword we rank #1 in Google. Nevertheless, I got a Grade F on SEOMoz regarding page optimization. All comments were certainly true. On another keyword (keyword 2) we got a grade A, on this keyword we rank #3. Strange enough I did linkbuilding on keyword 2 to the page regarding this keyword. I did not do linkbuilding for the first keyword. How can this be explained? Both keywords have average competition.
Link Building | | Onlinq0 -
Think I'm ready to do some link building. Couple questions.
Getting ready to do some link building. I've got several lists of competitors' links, including a bunch of sites with broken links that would be a great fit to link to us. I've got a capable VA to get started work on reaching out to people. Just curious if this is the right game plan, seems a little simple: For this round of link building I'm thinking all the links would point to my root domain. -Find quality sites/links to go after -Find an email to the owner/webmaster -Have the VA send them a value proposition email(i.e. why it's good fit for all)...or tell them about broken links etc. -Follow up myself when a response is generated. -Hope/verify they link to us. Thanks for the help with the newbie questions.
Link Building | | astahl110 -
10,000 links in 2 minutes
Hey guys. A belated happy new year to everyone who reads this! I had a strange experience yesterday with linking from a clients website footer. Basically, the client currently has a serious duplicate content problem caused by a multiple language plug in. It has made Google believe that there are 10 different versions of the clients website online (one for each language). It is a real estate website and there are quite a few pages anyway, but with the error, I would suggest the page count is now around 10,000. We are waiting for the developer who installed the plug in to repair the problem and without thinking it through really, yesterday, we made a text link to our home page in their footer. Overnight, our rankings for the keyword we used for the text link have dropped from pos. 2 page 1 down to halfway down page 2. Is this basically a sign that it is not good have this footer link from their site? I guess it is kind of like 10,000 weighted links being added in one day right? For now we have removed the link, but any help would be greatly appreciated. Cheers, Mark
Link Building | | Nextman0 -
Getting my crunchbase page to rank in au search engines
Hi, what can I do to make google think this is an Australian page? http://www.crunchbase.com/company/adserve-digital-signage Link to it from .com.au domains?
Link Building | | adam2012
Put my address in on the page as Australia? Is there any other ofpage things that could be done? I would like it to rank for "Digital Signage" Thanks0