Duplicate Content & Tags
-
I've recently added tags to my blog posts so that related blog posts are suggested to visitors.
My understanding was that my robot.txt was handling duplicate content so thought it wouldn't be an issue but after Moz crawled by site this week is reported 56 issues of duplicate content in my blog.
I'm using Shopify, so I can edit the robot.txt file but is my understanding correct that if there are 2 or more tags then they will be ignored? I've searched the Shopify documents and forum and can't find a straight answer. My understanding of SEO is fairly limited.
Disallow: /blogs/+
Disallow: /blogs/%2B
Disallow: /blogs/%2b -
If the only option is to disallow via the robots.txt, then I would agree with your setup - disallow the slugs specific to the tags you don't want indexed. I've heard shopify is a little rough to work with sometimes because of the limitations, so whatever you can do I think is better than nothing. Remember that the robots exclusion is treated as a suggestion and not a command, so if it's possible to assign a no-index meta tag to those URL types that would be best case.
Looks like you're on the right track with the post below:
{ % if handle contains "tagged" % }
{ % endif % }
The one suggestion I would make is that you use noindex,follow so the content will still be crawled, but the duplicate tag won't get indexed. That would create multiple paths to the content on your site, but not create an index bloat issue with multiple tags.
-
Yoast is a WordPress plugin, not Shopify so that option isn't available with the current CMS. Just wanted to chime in to make sure others aren't looking for Yoast SEO in the Shopify app store.
-
I'm using Meta Tagger as the SEO plugin, I've not heard of Yoast SEO but will certainly check it out.
I understand that I need to exclude the tags from being crawled and think I might have worked it out but I'm not 100% sure, as I mentioned my understanding is fairly limited.
My URL which is being seen as duplicate content looks like this
http://www.tangled-yarn.co.uk/blogs/news/tagged/sock-knitting
If I exclude the handle 'tagged' from being index this should work. I think the code should be
{ % if handle contains "tagged" % }
{ % endif % }
Do you think this will work?
-
Do you use Yoast SEO, or another plugin? The key is to set tags to no index so that the crawler only goes through your category links. The issue is that your tag URLs are being indexed and you don't want that. The option is under XML site map.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is there a good tool for finding Duplicate Content?
Hi! Are there any recommendation voor Duplicate Content finder tools? Is it offered on MOZ (not the one that belongs to 'seo issues') or a different site?
Content Development | | Marketing-SurpriseFactory1 -
Where to outsource product pages contents?
We have been told to write good unique content for every products but we just don't have the skill nor the time. (english is not my first-language) Can anyone suggest where to find a good product content writer?
Content Development | | ringochan0 -
How to fight against a site always "re-write" your content?
A site is always copying our content then re-write to their site, how to fight against this kind of action? (Many of those copied content can get a rank very closely behind us, which will grab some of our visits ) I tried to find DMCA, but as they have changed some paragraphes, etc, DMCA can't punish them as copying. I think many of you also have met such a problem, how will you handle this situation??
Content Development | | JonnyGreenwood0 -
Has Anyone Noticed Q&A has sped up a LOT?
A while back when things had really gotten over slow, I asked the opposite. Today I go on Q&A and the feel is quite a bit different. I also notice other cool little changes. I am wondering if moz did it just for me or is everyone seeing it??? As usual, steady improvement from the folks at SEOmoz. You guys are on. Thanks PS (For any who require uber speed, yes it takes about a second and a half for the response to load... I can live with that).
Content Development | | RobertFisher4 -
Content
Hi, We produce research report on same topic every year (e.g. cost of patrol in different part of the country) and publish them to a new url every time. What is the best way to do it? create new page every year or update the existing research report with modification Considering long term benefits. Thanks
Content Development | | APH0 -
Resolving duplicate text issues with a duplicate image?
We are a listing site for programs overseas. Many of our listings are inherently the same content, because in many cases the same exact information applies. We have resolved duplicate content issues to some extent by making some of the content in these listings unique. However, for the rest of the content which is going to be the same for about 100 pages, we were wondering if its better to have an image in place instead of duplicate text content (this would basically be an image of the text in question). We know this is a problem, because this is inherently duplicate content as well (only its a duplicate image instead of duplicate text). However, what's the best solution to this problem, and is a duplicate image just asking for trouble, or might this actually be a good idea?
Content Development | | dunklea0 -
Forum Site: Content Value Post Panda
I run a forum website built on Wordpress. We're about two years old. The theme of the site is a directory of attorneys, with each directory listing having its own blog account on our site. Through this platform, we receive 75-80 blog posts now every month of varying quality from our users. QUESTION: A good number of the blogs published on our site are also published on the attorney's law firm site as well (they're syndicating on our site). Will this hurt our site in light of Panda? A lot of the syndicated content is very well written and insightful. By contrast, Will non-syndicated but average to below average posts hurt our site? The authors almost always link back to their firm site. Would love some feedback on whether we should be happy about the syndicated content or whether we should potentially ban it?
Content Development | | JSOC0 -
Content issue
Hi, Quick question; I have set up a micro site in which i was going to take some of the content from my reviews and recipes my customers have posted and have them placed on my other site. The site i currently have is a large site receiving over 200,00 visitors every day. Will this be affected as duplicate content if i was to do this as i do not want to affect my rankings. Any suggestions what i can do to get round this? Cheers
Content Development | | wazza19851