What should be noindexed on a Wordpress blog?
-
I know this can be a "it depends" answer so I'll try to explain. Qualifications on your answers would be great.
I use the Wordpress architecture for myself and clients on sites and blogs. Almost every business site we create has a blog and I'm always working to improve results on them. My strategy has been the following:
- Categories: General, main content types, general keywords. Index, follow
- Tags: Very specific, post specific, may only be used once for one post.
My categories have descriptions that are displayed on the category pages with excerpts. Tags rarely have a description but are displayed with excerpts on the page.
My idea has been to index the categories to crawl the content and they have unique content by showing the category description. Tags shouldn't be archived because they may be all over the place and may have only 1 post with no tag description. I'm trying to reduce duplicate content but I don't want to limit results for my clients and myself.
Should I set tags to noindex, follow or should I have them indexed?
The only thing I'm thinking with having the tags indexed is that I may be able to get additional traffic through the more specific tags (i.e. tag = meta tags, category = SEO).
-
Thank you for your update!
I agree with your tests and your solution is probably the best also from a user experience point of view: giving a nice description and useful links on category pages should improve the number of pageviews / time spent on site.
-
Thanks for replying and giving us a status update. It's always great to know what happens with the advice so we can all learn. Glad to hear you're getting such good results!
-
For anyone that's interested in results, I've taken my blog that had everything nonindex, follow (categories and tags) and set categories to index, follow and tags to noindex, follow. I've seen about a 20% increase in traffic (not all due to this), my category pages are indexed and cached, and they're being used as entrance pages in some cases. Note that I did add good descriptions for these and I'm displaying them on the category page.
I also took another blog that had everything index, follow and changed it to the same that I just described. They have seen a reduction in their bounce rate and an increase in traffic.
On the same subject, I've also changed my paginated pages (archive pages 2+) to noindex, follow. They pretty much look the same as page 1 and they're pretty low quality landing pages. I've just added it but I noticed many recommendations to do it, Yoast.com does, and I see it on other big sites.
-
I think you may have hit on some key points here that kind of work into my initial thoughts:
- Amount of high quality content
- Highly organized category/tag structure
I believe that if you have these two key attributes for your site, having your categories and tags indexed would be very useful. In myself and the clients that I work with, I feel like the categories have plenty of high quality content but the tags are hit or miss.
From hearing the discussions of others and my own experience, I feel like having the categories indexed and the tags noindex would work out well but I think it's worth a shot to index my tags and see what happens. I'm sure Google and SEOmoz will let me know if I have some big dupliate content issues and I can easily monitor the traffic to these pages.
The interesting statistic for the tag pages will be the bounce rate...
-
Ryan, I have to say that you do bring a great point here and kudos to you on that. I think I may have jumped the gun a little bit in my initial response without considering the exact situation.
If you look at site like Compendium, along with Smashing Magazine and Noupe, they use this same method. Although, they a lot of high quality content, get tons of traffic and their category and tag structure are highly organized. This does work well, but from my experience, if you don't have all of those keys in place then you won't rank well for those categories in search results. On the other hand, here at SEOmoz, they do not have their tags and categories indexed, but they have the organization, traffic and content. Although, the only difference is that SEOmoz isn't using URL friendly slugs for these categories...
Maybe the better suggestion to Jared should be, try it both ways. Use noindex, follow at first for a month or so, then switch to indexing them. Test each method and see what results you get for your blog. It won't hurt your site in any way. I would just suggest that if you are going to index categories that you make sure you have thought through your level of organization.
-
I really wonder about this assumption that Google will ding a blog for duplicate content based on category and tag pages. As Jared pointed out typically those pages only show snippets. I don't know one way or the other, but I'm inclined to think Google is smart enough not to respond with a penalty. TKIG and Dan, I'm not disagreeing with you because I have no data to support one opinion or the other, but I'm very curious what you are basing your opinions on. FYI, this approach is nearly identical to the strategy Compendium uses to generate long tail search landing pages and they claim to have no duplicate content issues.
-
The Wordpress SEO plugin by Yoast doesn't no index both by default and I would give him more authority on SEO than the all in one SEO pack. Maybe it's a "depends on the situation"?
I guess it sounds like noindex, follow tag pages there is a consensus but I'm surprised at everyone saying noindex, follow on the category pages. With providing a category description and only displaying an excerpt from the posts, I feel like you have a good page that should be indexed.
I guess that brings up a good question on the measure of duplicate content. Is seomoz pro crawler a good enough measure of duplicate content or is Google super sensitive?
-
The all in one seo pack plugin for wordpress automatically sets your category and tags pages to noindex, so that's a good clue right there. I never indesx them for duplicate content issues. I also don't index the date archives either. Of course I never link to them either or really use categories or tags, so it's never been much of an issue for me.
-
Tags and categories in Wordpress should always be set to noindex, follow. Why? Usually by allowing the search engines to index WordPress tags and categories you create duplicate content. If you have a lot of tags and categories you also create a numerous amount of non-signifcant search results for your domain.
EDIT: You are not hindering search results for potential visitors by not indexing your tags and categories. You are simply keeping them from being cached and indexed in search results. For SEO purposes it is much better to noindex, follow these pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Panda Cleanup - Removing Old Blog Posts, Let Them 404 or 301 to Main Blog Page?
tl;dr... Removing old blog posts that may be affected by Panda, should we let them 404 or 301 to the Blog? We have been managing a corporate blog since 2011. The content is OK but we've recently hired a new blogger who is doing an outstanding job, creating content that is very useful to site visitors and is just on a higher level than what we've had previously. The old posts mostly have no comments and don't get much user engagement. I know Google recommends creating great new content rather than removing old content due to Panda concerns but I'm confident we're doing the former and I still want to purge the old stuff that's not doing anyone any good. So let's just pretend we're being dinged by Panda for having a large amount of content that doesn't get much user engagement (not sure if that's actually the case, rankings remain good though we have been passed on a couple key rankings recently). I've gone through Analytics and noted any blog posts that have generated at least 1 lead or had at least 20 unique visits all time. I think that's a pretty low barrier and everything else really can be safely removed. So for the remaining posts (I'm guessing there are hundreds of them but haven't compiled the specific list yet), should we just let them 404 or do we 301 redirect them to the main blog page? The underlying question is, if our primary purpose is cleaning things up for Panda specifically, does placing a 301 make sense or would Google see those "low quality" pages being redirected to a new place and pass on some of that "low quality" signal to the new page? Is it better for that content just to go away completely (404)?
Technical SEO | | eBoost-Consulting0 -
Bolt on Blog Software
We have several large eCommerce websites built on Cold Fusion. It is running on IIS, not Apache. We are looking for a blogging package (CMS) that we can bolt on to the website. We don't want the blog residing in a sub-domain. The blog needs to reside in a folder. NO => blog.mydomain.com YES => www.mydomain.com/blog/ Has anyone ever adapted Wordpress for this type of situation? Can WordPress reside in a folder? Are there any other suggestions?
Technical SEO | | AMHC0 -
Should I use a canonical tag or 301 with Wordpress posts?
Hi all, I'm trying to determine if canonical or 301 is a better way of handling an issue on my site. The Background I've got a Wordpress website where pages are in-depth reference articles and the posts are for short news blurbs. When I produce a new resource page, I also make a short post telling readers about the new resource. I use Yoast's Wordpress SEO plug in. Sometimes, Google will rank the 200 word post higher than the 2000 word resource page. I suspect that is because of the order in which they were crawled by Google, but I do not know for sure. The Question To make sure that the resource page is seen as the most important location on the site for the topic, should I use the canonical section in the Yoast plugin on the post to point to the page? Or should I wait, and after a few days (when the news blurb is off of the first page) just 301 the post to the page? Are there any link juice considerations when using the canonical option? Thanks for the help! Richard
Technical SEO | | RichardInFlorida0 -
Duplicate Titles on Wordpress blog pages
Hi, I have an issue where I am getting for duplicate page titles for pages that shouldn't exist. The issue is on the blog index page's (from 0 - 16) and involves the same set of attachment_id for each page, i.e. /blog/page/10/?attachment_id=minack /blog/page/10/?attachment_id=ponyrides /blog/page/11/?attachment_id=minack /blog/page/11/?attachment_id=ponyrides There are 6 attachment_id values (and they are not ID values either) which repeat for every page on the index now what I can't work out is where those 6 links are coming from as on the actual blog index page http://www.bosinver.co.uk/blog/page/10/ there are no links to it and the links just go to blog index page and it ignores the attachment_id value. There is no sitemap.xml file either which I thought might have contained the links. Thanks
Technical SEO | | leapSEO0 -
Send noindex, noarchive with 410?
My classifieds site returns a 410 along with an X-Robots-Tag HTTP header set to "noindex,noarchive" for vehicles that are no longer for sale. Google, however, apparently refuses to drop these vehicles from their index (at least as reported in GWT). By returning a "noindex,noarchive" directive, am I effectively telling the bots "yeah, this is a 410 but don't record the fact that this is a 410", thus effectively canceling out the intended effect of the 410?
Technical SEO | | tonyperez0 -
I am trying to correct error report of duplicate page content. However I am unable to find in over 100 blogs the page which contains similar content to the page SEOmoz reported as having similar content is my only option to just dlete the blog page?
I am trying to correct duplicate content. However SEOmoz only reports and shows the page of duplicate content. I have 5 years worth of blogs and cannot find the duplicate page. Is my only option to just delete the page to improve my rankings. Brooke
Technical SEO | | wianno1680 -
Understanding Duplicate Titles in Wordpress
I have duplicate title errors in Wordpress and I cannot pinpoint the problem. I have my blog set up so that the home page of the blog has the most recent posts. In my campaign report somehow the page directory is being found and I can't find any links on my blog to those pages. the errors are on pages that are like the following www.example.com/blog/page/13/ www.example.com/blog/page/14/ I am using Yoast and I thought I had it set up correctly. The other pages have the correct title and canonical tags, but he urls ending with page do not, but the page directory is duplicating the home page title. How or where can i fix this issue?
Technical SEO | | hfranz0 -
WordPress & Page Numbers
Hi, I am working on a large WP site for a client and have an issue with duplicate content and page numbers. I am using the Yoast SEO plugin but can't seem to resolve the issue. Let me give an example: If I go to a popular category, for example F1, there are over 10 pages of content for the category and although the URL changes, the Title and Meta Description stay the same. Now...if I was using a template for the title and description I could add the page number variable, but as I am overwriting the template with SEO specific category information I can't use variables and hence the problem! This is such a common problem I know somebody will have an answer! Thanks
Technical SEO | | JonathanSmith0