Block /tag/ or not?
-
I've asked this question in another area but now i want to ask it as a bigger question. Do we block /tag/ with robots.txt or not. Here's why I ask:
My wordpress site does not block /tag/ and I have many /tag/ results in the top 10 results of Google. Have for months. The question is, does Google see /tag/ on WordPress as duplicate content? SEOMoz says it's duplicate content but it's a tag. It's not really content per say.
I'm all for optimizing my site but Google is not penalizing me for /tag/ results.
I don't want to block /tag/ if Google is not seeing it as duplicate content for only one reason and that's because I have many results in the top 10 on G.
So, can someone who knows more about this weigh in on the subject for I really would like a accurate answer.
Thanks in advance...
-
Thanks for all the info. Last question, does having a list of monthly archives on the bottom of my site hurt in terms of dup content? I just have at the bottom the month/year and when you click it, it shows all the posts in that month. Should I be removing this or does it matter?
-
It would be meta noindex. Yoast is my plugin of choice. Happen to have a little article right here if you need to see if its "safe" to remove them from a traffic standpoint.
-Dan
-
I use All in one SEO pack and have checked noindex for the tags and the categories and the archives. I suppose it doesn't make any difference if I do it there or in the robots.txt file. Either way their being blocked. Do you know if there's a penalty for having blocked them in WP and the robots file?
-
I'd say noindex, follow them - many SEO plugins can do this for you, Yoast SEO for example. That way Googs can still crawl them, which may assist with discovery, but won't index them.
-
Exactly what I was looking for. Thank you!
So, I suppose the best and proper way to block it is by robots.txt correct?
-
You mean "more about this" than me? I run 3 businesses on 3 Wordpress blogs. I've done the research. Many of my clients are Wordpress users. But here's what others think:
- Yoast thinks it's duplicate content: http://yoast.com/articles/wordpress-seo/#advancedseo
- David Fuller ranked for tags then didn't: http://www.seomoz.org/q/wordpress-tags-duplicate-content Same link Dan at Evolving thinks you should noindex tags as well.
- WPMU and Matt Cutts think it's duplicate content: http://wpmu.org/categories-tags-and-how-to-avoid-duplicate-content-on-wordpress/
- How to Tech thinks it's duplicate content: http://howtotechtips.com/remove-wordpress-duplicate-content-search-results-and-tags-from-google/
- As you said, SEOMoz thinks it's duplicate content.
- Many Warriors suggest noindexing tags for dupe content reasons: http://www.warriorforum.com/adsense-ppc-seo-discussion-forum/373744-wordpress-tags-death-me-duplicate-content-question.html
- 3 other pro SEOs say to noindex here: http://www.seomoz.org/q/solving-link-and-duplicate-content-errors-created-by-wordpress-blog-and-tags
Google search shows
_No results found for _"tags do not create duplicate content".
No results found for "tags are not duplicate content".
And 2.5 million results for tags "duplicate content"
The short term answer is that you're ranking for them now so leave them be.
The long term answer is it's duplicate content and you need to fix it.
Even if your tag pages don't show the entire post, multiple tag pages show the same excerpt. This is duplicate content. By itself - not even talking about the post.
**You said: **_SEOMoz says it's duplicate content but it's a tag. It's not really content per say. _
If you want to see with your own eyes the duplicate content, please post a URL.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Robots.txt Disallow: / in Search Console
Two days ago I found out through search console that my website's Robots.txt has changed to User-agent: *
Technical SEO | | RAN_SEO
Disallow: / When I check the robots.txt in the website it looks fine - I see its blocked just in search console( in the robots.txt tester). when I try to do fetch as google to the homepage I see its blocked. Any ideas why would robots.txt block my website? it was fine until the weekend. before that, in the last 3 months I saw I had blocked resources in the website and I brought back pages with fetch as google. Any ideas?0 -
Is it necessary to 301 rewrite /index.php to /?
Hi, We have build a lot of external link to http://www.oursite.com/ Do I have to do a 301 redirect from http://www.oursite.com/index.php to http://www.outsite.com/? Thanks
Technical SEO | | LauraHT0 -
Nesting tag within tables?
I am working with a site that is using tables to display data. My question is should I nest header tags within the table header , or tags. For example, the beginning of a new row could have a "row header" that is an tag, or the caption is an .
Technical SEO | | OlivierChateau0 -
Googleoff/on tags
Hi all, I'd like to restrict Google indexing a part of content on the page. Does tag really work for it as it described on https://developers.google.com/search-appliance/documentation/46/admin_crawl/Preparing#pagepart? Thanks, Jane
Technical SEO | | Jane_Barry0 -
Joomla problem, title tag too long
Another problem SEOMOZ reported is that my title tags are too long. However, when I type in the title and the description for a particular page on Joomla, the description later appears not only as the meta description, but as part of the page title as well, thus the title appears to be too long. I have no idea how to seperate those two. Anyone?
Technical SEO | | polyniki0 -
Robots.txt and canonical tag
In the SEOmoz post - http://www.seomoz.org/blog/robot-access-indexation-restriction-techniques-avoiding-conflicts, it's being said - If you have a robots.txt disallow in place for a page, the canonical tag will never be seen. Does it so happen that if a page is disallowed by robots.txt, spiders DO NOT read the html code ?
Technical SEO | | seoug_20050 -
Should I Block Tag, Category, Author Pages
Just finished reviewing the first crawl of my first SEOmoz campaign for a site that I am working on. The site I"m working on uses Wordpress as a CMS, and most if not all of the warnings and notices have to do with author, category, and tag pages. Should I block these from being indexed? Why or why not?
Technical SEO | | Falconberg0 -
Empty <a>tag (no href or name attribute specificed) potential effect on link juice</a>
I have a client that insists on using the ProPhoto WordPress theme. This theme has an interesting habit of putting empty anchor tags in the site nav in order to nest css dropdowns. By empty I mean totally empty. For example: <a>Navigation Link</a> Since the anchor does not specify a destiation, do you think it would have any effect on link juice one way or the other? This wouldn't count as an additional link on the page would it? My inclination and personal practice is not to risk quirky things like this, but I'd like a second opinion before I suggest changes to the client's site. Thanks!
Technical SEO | | Dameian2