Should I check Use noindex for Tag Archives?
-
I have a page indexed > (http://mysite.com/mypost) and also http://mysite.com/tag/mypost The same post shows up twice, one with /tag/ one without when I search site:http://mysite.com
Is this a duplicate content?? Can I get penalized for this?In the All in one plugin should I check Use noindex for Tag Archives to avoid this or doesn't matter.
Thanks -
very good and well thought out answer.
-
thanks bemcapaz & Marcus for expert advice. wht u think if we control how much content to be shown on tag pages .. like this http://www.lancelhoff.com/change-the-excerpt-length-wordpress/. is it ok? actually i m getting traffic from TAG pages too... .
-
Most of my sites uses Wordpress, what I did to never have any duplicate content is the following:
First, I have the following plugins installed
- .html on PAGES
- All in ONe SEO Pack
- cbnet Ping Optimizer
- Google XML Sitemaps
Then, added the following text to the robots.txt
User-agent: *
Disallow: /wp-adminDisallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackbackDisallow: /comment
Disallow: /categoria//
Disallow: */trackback
Disallow: */comments
Disallow: /sem-categoria
Disallow: /pollsarchive
Disallow: /category
Disallow: /?
Disallow: /*?
Disallow: /*.php$
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.css$
Disallow: /*.gz$
Disallow: /*.wmv$
Disallow: /*.cgi$
Disallow: /*.xhtml$
Allow: /wp-content/uploads
Google ImageUser-agent: Googlebot-ImageDisallow:Allow: /* # Google AdSenseUser-agent: Mediapartners-GoogleDisallow:Allow: / # digg mirrorUser-agent: duggmirrorDisallow: / Sitemap: http://www.YOURSITE.com.br/sitemap.xml
On the admin in the PERMALINK config tab, in the COMMON SETTINGS i choose
- Custom Structure -> /%postname%.html
In SETTINGS > cbnet Ping Optimizer I inserted
http://blogsearch.google.com/ping/RPC2
http://ping.weblogalot.com/rpc.php
http://ping.syndic8.com/xmlrpc.php
http://rpc.technorati.com/rpc/ping
http://rpc.reader.livedoor.com/ping
http://www.blogpeople.net/servlet/weblogUpdates
http://audiorpc.weblogs.com/RPC2
I use this plugin to make sure that wordpress will not ping those services everytime I change or update something on the page,actually I seted the plugin to ping only after 30 min after the last ping.
So If you just posted something on Wordpress it will ping all those services for a fast index, however, if for some reason you have to edit the post when you save this plugin will make sure the services will not get pingged again in such a short space of time.
In the All in One Seo config I have the following config
UNCHECKED
- Use noindex for Categories
- Use noindex for Tag Archives
- Autogenerate Description
I also set Exlcude Pages, Additional Post Headers, Additional Page Headers and Additional Home Headers all blank
With all this configuration if someone access any post of my blogs they get a page with http://domain/post permalink structure, doesnt matter if the access came from a TAG, Categorie or normal Search.
Aditionally the main Tag page and Categorie page are indexed, so i ended up using my tags for some sort of relevance to the posts that belongs to that Tag. In google search the same post could appear by many related TAGs filter but the content of the post appears in an unique page.
Hope that helps
PS.: Suggestions to improve this config are welcome
-
Hey, I am guessing this is a wordpress site?
You could solve this a couple of ways
- 301 redirect the duplicate page - not recommended as it is a valid page but it may work
- canonical link on both pages showing the main version of this content
- noindex the tag page
Alternatively, you can use options 2 & 3 and it will resolve it.
If it's wordpress, happy to take a look at the actual page if it helps? I spend a lot of time tinkering with wordpress so there maybe another way & this answer is based on some assumption without real links.
Marcus
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Are keywords in the title tag becoming redundant?
I've noticed that lot's of the world's leading digital agencies are not using keywords in their titles. Eg AKQA, DigitasLBi, POKE, SYZYGY etc. Why is that? Are keywords no longer that important? This can't be accidental seeing as it's the case for so many leading agencies.
Intermediate & Advanced SEO | | RRoginator0 -
Too many Tags and Categories what should I do to clean this up?
Hello, Everyone! I am trying to do a clean up for one of my client sites. I'm noticing that the Categories and tags are way out of hand. It looks like random tags and categories were just added because they could be added. Are all of these tags and categories contributing to duplicate content? And if so What method should I go about to cleaning this up? The only thing that seems logical to me is rel=canonical. Thank you so much!
Intermediate & Advanced SEO | | Striventa1 -
Can I use two sitemaps?
I have a Magento website. I am going to add a Wordpress blog under /blog. If I setup each with its own webmaster tools to submit a sitemap does it hurt anything?
Intermediate & Advanced SEO | | Tylerj0 -
Google Ignoring Canonical Tag for Hundreds of Sites
Bazaar Voice provides a pretty easy-to-use product review solution for websites (especially sites on Magento): https://www.magentocommerce.com/magento-connect/bazaarvoice-conversations-1.html If your product has over a certain number of reviews/questions, the plugin cuts off the number of reviews/questions that appear on the page. To see the reviews/questions that are cut off, you have to click the plugin's next or back function. The next/back buttons' URLs have a parameter of "bvstate....." I have noticed Google is indexing this "bvstate..." URL for hundreds of sites, even with the proper rel canonical tag in place. Here is an example with Microsoft: http://webcache.googleusercontent.com/search?q=cache:zcxT7MRHHREJ:www.microsoftstore.com/store/msusa/en_US/pdp/Surface-Book/productID.325716000%3Fbvstate%3Dpg:8/ct:r+&cd=2&hl=en&ct=clnk&gl=us My website is seeing hundreds of these "bvstate" urls being indexed even though we have a proper rel canonical tag in place. It seems that Google is ignoring the canonical tag. In Webmaster Console, the main source of my duplicate titles/metas in the HTML improvements section is the "bvstate" URLs. I don't necessarily want to block "bvstate" in the robots.txt as it will prohibit Google from seeing the reviews that were cutoff. Same response for prohibiting Google from crawling "bvstate" in Paramters section of Webmaster Console. Should I just keep my fingers crossed that Google honors the rel canonical tag? Home Depot is another site that has this same issue: http://webcache.googleusercontent.com/search?q=cache:k0MBLFcu2PoJ:www.homedepot.com/p/DUROCK-Next-Gen-1-2-in-x-3-ft-x-5-ft-Cement-Board-172965/202263276%23!bvstate%3Dct:r/pg:2/st:p/id:202263276+&cd=1&hl=en&ct=clnk&gl=us
Intermediate & Advanced SEO | | redgatst1 -
What tags/coding are not good for SEO?
what tags/coding are not good for SEO? and also what tags not to include while creating website. For example - I read some where to avoid Span tag.
Intermediate & Advanced SEO | | JordanBrown0 -
Noindex a meta refresh site
I have a client's site that is a vanity URL, i.e. www.example.com, that is setup as a meta refresh to the client's flagship site: www22.example.com, however we have been seeing Google include the Vanity URL in the index, in some cases ahead of the flagship site. What we'd like to do is to de-index that vanity URL. We have included a no-index meta tag to the vanity URL, however we noticed within 24 hours, actually less, the flagship site also went away as well. When we removed the noindex, both vanity and flagship sites came back. We noticed in Google Webmaster that the flagship site's robots.txt file was corrupt and was also in need of fixing, and we are in process of fixing that - Question: Is there a way to noindex vanity URL and NOT flagship site? Was it due to meta refresh redirect that the noindex moved out the flagship as well? Was it maybe due to my conducting a google fetch and then submitting the flagship home page that the site reappeared? The robots.txt is still not corrected, so we don't believe that's tied in here. To add to the additional complexity, the client is UNABLE to employ a 301 redirect, which was what I recommended initially. Anyone have any thoughts at all, MUCH appreciated!
Intermediate & Advanced SEO | | ACNINTERACTIVE0 -
Link + noindex vs canonical--which is better?
In this article http://support.google.com/webmasters/bin/answer.py?hl=en&answer=66359 google mentions if you syndicate content, you should include a link and, ideally noindex, the content, if possible. I'm wondering why google doesn't mention including a canonical instead the link + noindex? Is one better than the other? Any ideas?
Intermediate & Advanced SEO | | nicole.healthline0 -
Archive or no archive?... That is the question!
When running a classified site, what is best practice for what to do with expired ads? Should they stay on the site with a sold stamp perhaps? Or should they be moved to an archive subdomain, with the original URL 301 redirecting to the new archive ad? I'm kinda thinking the second option but I suppose the only issue with this is you would have to have a consistent flow of new ads on the site to prevent categories from getting too thin. Thoughts on this and any other/better solutions would be much appreciated. Thanks.
Intermediate & Advanced SEO | | Sayers0