Should I check Use noindex for Tag Archives?
-
I have a page indexed > (http://mysite.com/mypost) and also http://mysite.com/tag/mypost The same post shows up twice, one with /tag/ one without when I search site:http://mysite.com
Is this a duplicate content?? Can I get penalized for this?In the All in one plugin should I check Use noindex for Tag Archives to avoid this or doesn't matter.
Thanks -
very good and well thought out answer.
-
thanks bemcapaz & Marcus for expert advice. wht u think if we control how much content to be shown on tag pages .. like this http://www.lancelhoff.com/change-the-excerpt-length-wordpress/. is it ok? actually i m getting traffic from TAG pages too... .
-
Most of my sites uses Wordpress, what I did to never have any duplicate content is the following:
First, I have the following plugins installed
- .html on PAGES
- All in ONe SEO Pack
- cbnet Ping Optimizer
- Google XML Sitemaps
Then, added the following text to the robots.txt
User-agent: *
Disallow: /wp-adminDisallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackbackDisallow: /comment
Disallow: /categoria//
Disallow: */trackback
Disallow: */comments
Disallow: /sem-categoria
Disallow: /pollsarchive
Disallow: /category
Disallow: /?
Disallow: /*?
Disallow: /*.php$
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.css$
Disallow: /*.gz$
Disallow: /*.wmv$
Disallow: /*.cgi$
Disallow: /*.xhtml$
Allow: /wp-content/uploads
Google ImageUser-agent: Googlebot-ImageDisallow:Allow: /* # Google AdSenseUser-agent: Mediapartners-GoogleDisallow:Allow: / # digg mirrorUser-agent: duggmirrorDisallow: / Sitemap: http://www.YOURSITE.com.br/sitemap.xml
On the admin in the PERMALINK config tab, in the COMMON SETTINGS i choose
- Custom Structure -> /%postname%.html
In SETTINGS > cbnet Ping Optimizer I inserted
http://blogsearch.google.com/ping/RPC2
http://ping.weblogalot.com/rpc.php
http://ping.syndic8.com/xmlrpc.php
http://rpc.technorati.com/rpc/ping
http://rpc.reader.livedoor.com/ping
http://www.blogpeople.net/servlet/weblogUpdates
http://audiorpc.weblogs.com/RPC2
I use this plugin to make sure that wordpress will not ping those services everytime I change or update something on the page,actually I seted the plugin to ping only after 30 min after the last ping.
So If you just posted something on Wordpress it will ping all those services for a fast index, however, if for some reason you have to edit the post when you save this plugin will make sure the services will not get pingged again in such a short space of time.
In the All in One Seo config I have the following config
UNCHECKED
- Use noindex for Categories
- Use noindex for Tag Archives
- Autogenerate Description
I also set Exlcude Pages, Additional Post Headers, Additional Page Headers and Additional Home Headers all blank
With all this configuration if someone access any post of my blogs they get a page with http://domain/post permalink structure, doesnt matter if the access came from a TAG, Categorie or normal Search.
Aditionally the main Tag page and Categorie page are indexed, so i ended up using my tags for some sort of relevance to the posts that belongs to that Tag. In google search the same post could appear by many related TAGs filter but the content of the post appears in an unique page.
Hope that helps
PS.: Suggestions to improve this config are welcome
-
Hey, I am guessing this is a wordpress site?
You could solve this a couple of ways
- 301 redirect the duplicate page - not recommended as it is a valid page but it may work
- canonical link on both pages showing the main version of this content
- noindex the tag page
Alternatively, you can use options 2 & 3 and it will resolve it.
If it's wordpress, happy to take a look at the actual page if it helps? I spend a lot of time tinkering with wordpress so there maybe another way & this answer is based on some assumption without real links.
Marcus
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Site moved. Unable to index page : Noindex detected in robots meta tag?!
Hope someone can shed some light on this: We moved our smaller site (into the main site ( different domains) . The smaller site that was moved ( https://www.bluegreenrentals.com)
Intermediate & Advanced SEO | | bgvsiteadmin
Directory where the site was moved (https://www.bluegreenvacations.com/rentals) Each page from the old site was 301 redirected to the appropriate page under .com/rentals. But we are seeing a significant drop in rankings and traffic., as I am unable to request a change of address in Google search console (a separate issue that I can elaborate on). Lots of (301 redirect) new destination pages are not indexed. When Inspected, I got a message : Indexing allowed? No: 'index' detected in 'robots' meta tagAll pages are set as Index/follow and there are no restrictions in robots.txtHere is an example URL :https://www.bluegreenvacations.com/rentals/resorts/colorado/innsbruck-aspen/Can someone take a look and share an opinion on this issue?Thank you!0 -
Wordpress Tags error in MOZ
Hi, We are getting an enormous amount of missing meta description only on our tag archives. When we post we fill in a description and are using the Yoast plugin ( getting green lights). Now we are finding that we're missing descriptions in tags archives. What is the best thing to do? We're finding that the tags are creating a separate url for each tag that has missing description even though the post has a full description. 1. To block spiders from crawling tags? 2. To stop using tags? 3. What do you suggest? Thank you
Intermediate & Advanced SEO | | WalterHalicki0 -
Should I use noindex or robots to remove pages from the Google index?
I have a Magento site and just realized we have about 800 review pages indexed. The /review directory is disallowed in robots.txt but the pages are still indexed. From my understanding robots means it will not crawl the pages BUT if the pages are still indexed if they are linked from somewhere else. I can add the noindex tag to the review pages but they wont be crawled. https://www.seroundtable.com/google-do-not-use-noindex-in-robots-txt-20873.html Should I remove the robots.txt and add the noindex? Or just add the noindex to what I already have?
Intermediate & Advanced SEO | | Tylerj0 -
Duplicate title tags due to ?_escaped_fragment_=
Duplicate title tags due to /?escaped_fragment= in the serps, it look like this http://www.site.com/25621/post-name/#! http://www.site.com/25621/post-name/ Does anyone know what the best fix is for this and does this affect the sites performance. Regards T
Intermediate & Advanced SEO | | Taiger0 -
Canonicals: use when page has same listings, but displayed very differently?
Say you have a listing of movies. In that listing, there are 5 different view types. One has the scenes broken out. Another has only the box covers. Two of the views have movie descriptions, but others don't. Still, the listings themselves are the same, and you only want the default view to be indexed. Is it appropriate to use canonicals in this case? The alternative is to noindex the other views, but the site already has rankings and deep links. If Google does see the pages as unique and we apply a canonical, could we be penalized or would they merely ignore it?
Intermediate & Advanced SEO | | LahomaManagement0 -
Link + noindex vs canonical--which is better?
In this article http://support.google.com/webmasters/bin/answer.py?hl=en&answer=66359 google mentions if you syndicate content, you should include a link and, ideally noindex, the content, if possible. I'm wondering why google doesn't mention including a canonical instead the link + noindex? Is one better than the other? Any ideas?
Intermediate & Advanced SEO | | nicole.healthline0 -
Using the right Schema.org - & is there a penalty in using the wrong one?
Hi We have a set of reviewed products (in this case restaurants) that total an average rating of 4.0/5.0 from 800 odd reviews. We know to use schema/restaurant for individual restaurants we promote but what about for a list of cities, say restaurants in boston for example. For the product page containing all of Boston restaurants - should we use schema.org/restaurant (but its not 1 physical restaurant) or schema.org - product + agg review score? What do you do for your product listing pages? If we get it wrong, is there a penalty? Or this just simply up to us?
Intermediate & Advanced SEO | | xoffie1 -
Is having a canonical tag for the link that IS the canonical a negative thing?
Throughout our site, canonical tags have been added where needed. However, the canonical tags are also included for the canonical itself. For example, for www.askaquestion.com, the canonical tag has been added as www.askaquestion.com. Will this have a negative impact or does it not really matter whether there is such a loop?
Intermediate & Advanced SEO | | kbbseo0