Solved Duplicate content error affecting 142 pages
-
Hello,
Recently I noticed a new duplicate error notification.
This page: https://www.earley.com/insights/internet-things-and-product-data
is flagged as 'duplicate content' with 142 affected pages.
Here's an example of one of the affected pages:
https://www.earley.com/insights/how-ontologies-drive-digital-transformation
This is not an ecommerce site. The affected pages are blog posts. We are pretty prolific writers and over the years we have produced nearly 300 articles. We are a consulting firm and the articles are about our area of expertise and cover a wide range of topics within that space.
I just don't understand why this would be flagged as duplicate or what I'm supposed to do with this information!
Help!
Thanks!
Sharon -
@meghanpahinui said in Duplicate content error affecting 142 pages:
@eismarketing Hi Sharon!
Thanks so much for the great question! And so sorry for any confusion here.
Pages that are flagged as duplicate content are being assessed on the source code of those pages and not just the content on the page itself. Since it's not based purely on the written content of the page, this means if you're using a template of some kind or all your pages have a similar structure, they may end up being flagged as duplicate content. Pages can be marked as duplicates of each other when there isn't enough unique content on each page to distinguish them from each other.
The Moz tools have a 90% threshold for duplicate content so any pages with at least 90% of the same code will be flagged as duplicates of one another.
I've grabbed a few resources that may help:
Here is a Whiteboard Friday about duplicate content and some ways you can resolve it.
Here is an article from the Moz Learning Center regarding duplicate content.
Here is some information from Google re: duplicate content as well.At time of answering your query, you won't get a penalty for duplicate content, however anything you can do to help search engines understand what you content is about and to create value for your visitors, will support a strong content marketing and SEO strategy.
-
@eismarketing Hi Sharon!
Thanks so much for the great question! And so sorry for any confusion here.
Pages that are flagged as duplicate content are being assessed on the source code of those pages and not just the content on the page itself. Since it's not based purely on the written content of the page, this means if you're using a template of some kind or all your pages have a similar structure, they may end up being flagged as duplicate content. Pages can be marked as duplicates of each other when there isn't enough unique content on each page to distinguish them from each other.
The Moz tools have a 90% threshold for duplicate content so any pages with at least 90% of the same code will be flagged as duplicates of one another.
I've grabbed a few resources that may help:
Here is a Whiteboard Friday about duplicate content and some ways you can resolve it.
Here is an article from the Moz Learning Center regarding duplicate content.
Here is some information from Google re: duplicate content as well.At time of answering your query, you won't get a penalty for duplicate content, however anything you can do to help search engines understand what you content is about and to create value for your visitors, will support a strong content marketing and SEO strategy.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Duplicate Contents in Order Pages of Multiple Products
Hi, I have a website containing 30 software products. Each product has an order page. The problem is that the layout and content of these 30 order pages are very similar, except for the product name, for example: https://www.datanumen.com/access-repair-order/
On-Page Optimization | | ccw
https://www.datanumen.com/outlook-repair-order/
https://www.datanumen.com/word-repair-order/ Siteliner has reports these pages as duplicate contents. I am thinking of noindex these pages. However, in such a case, if a user search for "DataNumen Outlook Repair order page", then he will not be able to see the order page of our product, which drives the revenue go away. So, how to deal with such a case? Thank you.1 -
Content Issues: Duplicate Content
Hi there
Technical SEO | | Kingagogomarketing
Moz flagged the following content issues, the page has duplicate content and missing canonical tags.
What is the best solution to do? Industrial Flooring » IRL Group Ltd
https://irlgroup.co.uk/industrial-flooring/ Industrial Flooring » IRL Group Ltd
https://irlgroup.co.uk/index.php/industrial-flooring Industrial Flooring » IRL Group Ltd
https://irlgroup.co.uk/index.php/industrial-flooring/0 -
Can you use no-index to counter duplicate content across separate domains?
Hi Moz Community, I have a client who is splitting out a sub brand from a company website to its own domain. They have lots of content around the theme and they want to migrate most of the content out to the new domain, but they also wanted to keep that content on the main site as the main site gets lots of traffic. My question is, as they want search traffic to go to the new site, but want to keep the best content on the original site too, so it can be found in the nav, if they no-index identical content on main site and index content on the new site will they still be penalised for duplicate content? Our advice has been to keep the thematic content on both sites but make them different enough so they are not considered duplicate - we routinely write the same blog post in 50 different ways for them but their Head of Web asked if the no-index is a route, which means they don't need to pay for and wait for brand new content? They are comfortable in losing traffic until the new domain gets traction. In theory, if they are telling Google not to index or rank the main site content, the new site shouldn't be penalised but I'm not confident giving that advice as I've never been asked to do this before. Thoughts?
Technical SEO | | Algorhythm_jT0 -
Duplicate content, although page has "noindex"
Hello, I had an issue with some pages being listed as duplicate content in my weekly Moz report. I've since discussed it with my web dev team and we decided to stop the pages from being crawled. The web dev team added this coding to the pages <meta name='robots' content='max-image-preview:large, noindex dofollow' />, but the Moz report is still reporting the pages as duplicate content. Note from the developer "So as far as I can see we've added robots to prevent the issue but maybe there is some subtle change that's needed here. You could check in Google Search Console to see how its seeing this content or you could ask Moz why they are still reporting this and see if we've missed something?" Any help much appreciated!
Technical SEO | | rj_dale0 -
Multiple campaigns for similar pages
Hello, Moz family! I am fairly new to the SEO game, so this question may be irrelevant. Here is a little context to begin; the business I am serving has an overview page (see below), which I have started a campaign for. On the overview page, there are 10 different links that can take the user to a specific page. It is hard to gather rankings for these keywords because there are so many different pages we link to. I guess what I am asking is, is the only way to gauge keywords across multiple pages is to start multiple campaigns? I hope this makes sense, but if I need to clarify more please let me know! Thanks in advance!
Product Support | | BlakeSmith30 -
How do I stop these duplicate reports being emailed?
It used to be that I received just one weekly report per campaign when using MozPro. Over the last couple of weeks/month (since creating MozAnalytics reports) I've started to receive 2 reports for the same campaign...with no different whatsoever, apart from the time that they have been sent. I've been back into the old MozPro campaigns and deleted any automated reports that were being generated there, and so now I should have just one weekly MozAnalytics report from each campaign. Has anyone had this problem before and do they know how to fix it? Getting really annoying, especially with 13 campaigns resulting in 26 emails! Thanks
Product Support | | bricktech0 -
Duplicate content on ecommerce sites
I just want to confirm something about duplicate content. On an eCommerce site, if the meta-titles, meta-descriptions and product descriptions are all unique, yet a big chunk at the bottom (featuring "why buy with us" etc) is copied across all product pages, would each page be penalised, or not indexed, for duplicate content? Does the whole page need to be a duplicate to be worried about this, or would this large chunk of text, bigger than the product description, have an effect on the page. If this would be a problem, what are some ways around it? Because the content is quite powerful, and is relavent to all products... Cheers,
Intermediate & Advanced SEO | | Creode0