What should be noindexed on a Wordpress blog?
-
I know this can be a "it depends" answer so I'll try to explain. Qualifications on your answers would be great.
I use the Wordpress architecture for myself and clients on sites and blogs. Almost every business site we create has a blog and I'm always working to improve results on them. My strategy has been the following:
- Categories: General, main content types, general keywords. Index, follow
- Tags: Very specific, post specific, may only be used once for one post.
My categories have descriptions that are displayed on the category pages with excerpts. Tags rarely have a description but are displayed with excerpts on the page.
My idea has been to index the categories to crawl the content and they have unique content by showing the category description. Tags shouldn't be archived because they may be all over the place and may have only 1 post with no tag description. I'm trying to reduce duplicate content but I don't want to limit results for my clients and myself.
Should I set tags to noindex, follow or should I have them indexed?
The only thing I'm thinking with having the tags indexed is that I may be able to get additional traffic through the more specific tags (i.e. tag = meta tags, category = SEO).
-
Thank you for your update!
I agree with your tests and your solution is probably the best also from a user experience point of view: giving a nice description and useful links on category pages should improve the number of pageviews / time spent on site.
-
Thanks for replying and giving us a status update. It's always great to know what happens with the advice so we can all learn. Glad to hear you're getting such good results!
-
For anyone that's interested in results, I've taken my blog that had everything nonindex, follow (categories and tags) and set categories to index, follow and tags to noindex, follow. I've seen about a 20% increase in traffic (not all due to this), my category pages are indexed and cached, and they're being used as entrance pages in some cases. Note that I did add good descriptions for these and I'm displaying them on the category page.
I also took another blog that had everything index, follow and changed it to the same that I just described. They have seen a reduction in their bounce rate and an increase in traffic.
On the same subject, I've also changed my paginated pages (archive pages 2+) to noindex, follow. They pretty much look the same as page 1 and they're pretty low quality landing pages. I've just added it but I noticed many recommendations to do it, Yoast.com does, and I see it on other big sites.
-
I think you may have hit on some key points here that kind of work into my initial thoughts:
- Amount of high quality content
- Highly organized category/tag structure
I believe that if you have these two key attributes for your site, having your categories and tags indexed would be very useful. In myself and the clients that I work with, I feel like the categories have plenty of high quality content but the tags are hit or miss.
From hearing the discussions of others and my own experience, I feel like having the categories indexed and the tags noindex would work out well but I think it's worth a shot to index my tags and see what happens. I'm sure Google and SEOmoz will let me know if I have some big dupliate content issues and I can easily monitor the traffic to these pages.
The interesting statistic for the tag pages will be the bounce rate...
-
Ryan, I have to say that you do bring a great point here and kudos to you on that. I think I may have jumped the gun a little bit in my initial response without considering the exact situation.
If you look at site like Compendium, along with Smashing Magazine and Noupe, they use this same method. Although, they a lot of high quality content, get tons of traffic and their category and tag structure are highly organized. This does work well, but from my experience, if you don't have all of those keys in place then you won't rank well for those categories in search results. On the other hand, here at SEOmoz, they do not have their tags and categories indexed, but they have the organization, traffic and content. Although, the only difference is that SEOmoz isn't using URL friendly slugs for these categories...
Maybe the better suggestion to Jared should be, try it both ways. Use noindex, follow at first for a month or so, then switch to indexing them. Test each method and see what results you get for your blog. It won't hurt your site in any way. I would just suggest that if you are going to index categories that you make sure you have thought through your level of organization.
-
I really wonder about this assumption that Google will ding a blog for duplicate content based on category and tag pages. As Jared pointed out typically those pages only show snippets. I don't know one way or the other, but I'm inclined to think Google is smart enough not to respond with a penalty. TKIG and Dan, I'm not disagreeing with you because I have no data to support one opinion or the other, but I'm very curious what you are basing your opinions on. FYI, this approach is nearly identical to the strategy Compendium uses to generate long tail search landing pages and they claim to have no duplicate content issues.
-
The Wordpress SEO plugin by Yoast doesn't no index both by default and I would give him more authority on SEO than the all in one SEO pack. Maybe it's a "depends on the situation"?
I guess it sounds like noindex, follow tag pages there is a consensus but I'm surprised at everyone saying noindex, follow on the category pages. With providing a category description and only displaying an excerpt from the posts, I feel like you have a good page that should be indexed.
I guess that brings up a good question on the measure of duplicate content. Is seomoz pro crawler a good enough measure of duplicate content or is Google super sensitive?
-
The all in one seo pack plugin for wordpress automatically sets your category and tags pages to noindex, so that's a good clue right there. I never indesx them for duplicate content issues. I also don't index the date archives either. Of course I never link to them either or really use categories or tags, so it's never been much of an issue for me.
-
Tags and categories in Wordpress should always be set to noindex, follow. Why? Usually by allowing the search engines to index WordPress tags and categories you create duplicate content. If you have a lot of tags and categories you also create a numerous amount of non-signifcant search results for your domain.
EDIT: You are not hindering search results for potential visitors by not indexing your tags and categories. You are simply keeping them from being cached and indexed in search results. For SEO purposes it is much better to noindex, follow these pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Good to use disallow or noindex for these?
Hello everyone, I am reaching out to seek your expert advice on a few technical SEO aspects related to my website. I highly value your expertise in this field and would greatly appreciate your insights.
Technical SEO | | williamhuynh
Below are the specific areas I would like to discuss: a. Double and Triple filter pages: I have identified certain URLs on my website that have a canonical tag pointing to the main /quick-ship page. These URLs are as follows: https://www.interiorsecrets.com.au/collections/lounge-chairs/quick-ship+black
https://www.interiorsecrets.com.au/collections/lounge-chairs/quick-ship+black+fabric Considering the need to optimize my crawl budget, I would like to seek your advice on whether it would be advisable to disallow or noindex these pages. My understanding is that by disallowing or noindexing these URLs, search engines can avoid wasting resources on crawling and indexing duplicate or filtered content. I would greatly appreciate your guidance on this matter. b. Page URLs with parameters: I have noticed that some of my page URLs include parameters such as ?variant and ?limit. Although these URLs already have canonical tags in place, I would like to understand whether it is still recommended to disallow or noindex them to further conserve crawl budget. My understanding is that by doing so, search engines can prevent the unnecessary expenditure of resources on indexing redundant variations of the same content. I would be grateful for your expert opinion on this matter. Additionally, I would be delighted if you could provide any suggestions regarding internal linking strategies tailored to my website's structure and content. Any insights or recommendations you can offer would be highly valuable to me. Thank you in advance for your time and expertise in addressing these concerns. I genuinely appreciate your assistance. If you require any further information or clarification, please let me know. I look forward to hearing from you. Cheers!0 -
Noindex Success?
Has anyone had success implementing noindex/follow to pages from their site which has been hit by a Panda penalty? Our site has a lot of duplicate content for products descriptions that we had permission to use from our distributor (who is also online). We went ahead and noindex/follow those pages in the hopes that google will focus on the products that we carry that do have original descriptions (about 1/3 of our products). We didn't want to just remove those products since they are actually beneficial to our customers. Most of the duplication of content is in the form of ingredients lists.
Technical SEO | | dustyabe0 -
Can you noindex a page, but still index an image on that page?
If a blog is centered around visual images, and we have specific pages with high quality content that we plan to index and drive our traffic, but we have many pages with our images...what is the best way to go about getting these images indexed? We want to noindex all the pages with just images because they are thin content... Can you noindex,follow a page, but still index the images on that page? Please explain how to go about this concept.....
Technical SEO | | WebServiceConsulting.com0 -
Blog RSS behind https
Hi, I'm finding our blog's RSS feed won't be recognized by various websites. The feed is on a https url. Is this the most likely problem? Thanks!
Technical SEO | | OTSEO0 -
Timely use of robots.txt and meta noindex
Hi, I have been checking every possible resources for content removal, but I am still unsure on how to remove already indexed contents. When I use robots.txt alone, the urls will remain in the index, however no crawling budget is wasted on them, But still, e.g having 100,000+ completely identical login pages within the omitted results, might not mean anything good. When I use meta noindex alone, I keep my index clean, but also keep Googlebot busy with indexing these no-value pages. When I use robots.txt and meta noindex together for existing content, then I suggest Google, that please ignore my content, but at the same time, I restrict him from crawling the noindex tag. Robots.txt and url removal together still not a good solution, as I have failed to remove directories this way. It seems, that only exact urls could be removed like this. I need a clear solution, which solves both issues (index and crawling). What I try to do now, is the following: I remove these directories (one at a time to test the theory) from the robots.txt file, and at the same time, I add the meta noindex tag to all these pages within the directory. The indexed pages should start decreasing (while useless page crawling increasing), and once the number of these indexed pages are low or none, then I would put the directory back to robots.txt and keep the noindex on all of the pages within this directory. Can this work the way I imagine, or do you have a better way of doing so? Thank you in advance for all your help.
Technical SEO | | Dilbak0 -
Adding .html To Wordpress Site
I am working on a team (my part is the SEO) where the developer added the .html extension to the permalinks. I don't understand why, on Wordpress, you would do this. Is there any benefit, or penalty for it as an SEO standpoint? I usually just set mine up %postname% as the permalink structure, but I am not the web design lead on this project. I asked the designer why, but he seems to be reluctant to answer any of my emails about his work, (like he is above that or something). Not wanting to make things worse, I dropped it and thought I would ask here since I saw a few posts in reference to it today in the forum. Is there an advantage or disadvantage (either way) to using the .html extension on a Wordpress site?
Technical SEO | | kbloemendaal0 -
Noindex all dodgy content?
Hello should I be brutal with noindex? should I noindex anything of no value to websurfers? from my understanding, nofollow is different to to noindex? Google follows through the site crawling and discovering subpages but will not put the noindexed page in serps. Is that right? I have subcategory pages in a business directory site, these pages just have links to there subpages.
Technical SEO | | adamzski1 -
What is with WordPress Dupe issues?
Hi, Just wondering if anyone can explain for me why it seems every tag that is entered in WP blog posts on a site creates a duplicate page (identified by ROGER and friends in SEOmoz crawl)? Obviously if you can offer a solution (apart from the extremely obvious "don't use tags") I would be immensely grateful. Thanks so much,
Technical SEO | | ShaMenz0