Duplicate Content & Tags
-
I've recently added tags to my blog posts so that related blog posts are suggested to visitors.
My understanding was that my robot.txt was handling duplicate content so thought it wouldn't be an issue but after Moz crawled by site this week is reported 56 issues of duplicate content in my blog.
I'm using Shopify, so I can edit the robot.txt file but is my understanding correct that if there are 2 or more tags then they will be ignored? I've searched the Shopify documents and forum and can't find a straight answer. My understanding of SEO is fairly limited.
Disallow: /blogs/+
Disallow: /blogs/%2B
Disallow: /blogs/%2b -
If the only option is to disallow via the robots.txt, then I would agree with your setup - disallow the slugs specific to the tags you don't want indexed. I've heard shopify is a little rough to work with sometimes because of the limitations, so whatever you can do I think is better than nothing. Remember that the robots exclusion is treated as a suggestion and not a command, so if it's possible to assign a no-index meta tag to those URL types that would be best case.
Looks like you're on the right track with the post below:
{ % if handle contains "tagged" % }
{ % endif % }
The one suggestion I would make is that you use noindex,follow so the content will still be crawled, but the duplicate tag won't get indexed. That would create multiple paths to the content on your site, but not create an index bloat issue with multiple tags.
-
Yoast is a WordPress plugin, not Shopify so that option isn't available with the current CMS. Just wanted to chime in to make sure others aren't looking for Yoast SEO in the Shopify app store.
-
I'm using Meta Tagger as the SEO plugin, I've not heard of Yoast SEO but will certainly check it out.
I understand that I need to exclude the tags from being crawled and think I might have worked it out but I'm not 100% sure, as I mentioned my understanding is fairly limited.
My URL which is being seen as duplicate content looks like this
http://www.tangled-yarn.co.uk/blogs/news/tagged/sock-knitting
If I exclude the handle 'tagged' from being index this should work. I think the code should be
{ % if handle contains "tagged" % }
{ % endif % }
Do you think this will work?
-
Do you use Yoast SEO, or another plugin? The key is to set tags to no index so that the crawler only goes through your category links. The issue is that your tag URLs are being indexed and you don't want that. The option is under XML site map.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Clarification on duplicate content
Hi, if I have a page that unintentionally ranks for a term that I want to create a page for - say "atlanta apartments" - should I still create a page specifically intended to rank for "atlanta apartments"? Will canonical tags be crucial in this case? Hoping to avoid creating duplicate content and instead create the correct content for a specific term.
Content Development | | smiller760 -
I want to use some content that I sent out in a newsletter and post as a blog, but will this count as duplicate content?
I want to use some content that I sent out in a newsletter a while ago - adding it as a blog to my website. The newsletter exists on a http://myemail.constantcontact.com URL and is being indexed by Google. Will this count as duplicate content?
Content Development | | Wagada0 -
Simple Blog Content Question
Which is better? To write my own blog post or, (with permission) use other high DA content on my blog. I'll probably do both, but I'm very curious as to what the search engines prefer or which is better for seo. Thanks in advance!
Content Development | | MissThumann0 -
We want to move Content from one domain to another
We have a large amount of unique content on a domain we are no longer using/promoting. Its been sat there for a couple of years. Its literally wasted content on a non used or promoted domain. We want to move it to a busy site of ours. Are there any best practices or pitfalls we should be aware of?
Content Development | | Simonws0010 -
Kickass Tool for Content Writers
I have been a writer for a long time. I have done a lot of writing. Many excellent teachers, professors, bosses, colleagues, and editors have helped me. I've responded to a lot of red ink - a lot of red ink. A few days ago, I found a tool that has been extremely helpful. It has significantly improved the clarity of my writing. Using it on a piece of work makes me more confident about it at publication time. It requires a lot of work to use (at least it does for me) but the results are well worth the time. People who are serious about writing well will understand this tool immediately. http://www.hemingwayapp.com/ I don't own this website (I wish I did) and have no affiliation with it. Today they released a desktop version that they are almost giving away. I have not tried it yet but plan to instal it today.
Content Development | | EGOL6 -
My New blog has NO content since 2 months, the day it was launch, What to DO? Is it "DEAD"???
2 months ago, I publish a NEW blog, http://www.mervrating.org The blog has only 3 posts. I don't have much time to work on it. Does it HURT my SEO? Can I start working on it on regular basis and try to built authority or does it looks "dead" to search engine? I would like to bring it alive and give it a second chance, will it be hard if it has no content since the beginning? What is your opinions? Thank you, BigBlaze
Content Development | | BigBlaze2050 -
How to make new content Indexed faster by google
I would like to know what can I do. Normally it takes google around 3 days to index my content. I got a site map, swiched the crawling rate to the fastest in my webmaster tools. I also tried crawling my homepage as google bot and sending it to the index with all linked pages but even if I do so my content takes around 3 days if not more to get indexed. I publish around 20 posts a week. My SEOmoz page authority is 48. Some sites of my competition seem to be getting their content indexed in the same day. What else can be done?
Content Development | | sebastiankoch0 -
Integration of content on other sites
(by Google Traductor) Hello, we are able to make agreements with sites of good quality and reputation to integrate our classified ads for agropeuariosector on the websites of these companies. We fear that thesesites begin to index all this content and begin to compete with us in organic positioning. On the other hand this would generateduplicate content? That strategy will be applied in order to do so. Greetings and thanks!
Content Development | | romaro
Robert0