Solved Duplicate content error affecting 142 pages
-
Hello,
Recently I noticed a new duplicate error notification.
This page: https://www.earley.com/insights/internet-things-and-product-data
is flagged as 'duplicate content' with 142 affected pages.
Here's an example of one of the affected pages:
https://www.earley.com/insights/how-ontologies-drive-digital-transformation
This is not an ecommerce site. The affected pages are blog posts. We are pretty prolific writers and over the years we have produced nearly 300 articles. We are a consulting firm and the articles are about our area of expertise and cover a wide range of topics within that space.
I just don't understand why this would be flagged as duplicate or what I'm supposed to do with this information!
Help!
Thanks!
Sharon -
@meghanpahinui said in Duplicate content error affecting 142 pages:
@eismarketing Hi Sharon!
Thanks so much for the great question! And so sorry for any confusion here.
Pages that are flagged as duplicate content are being assessed on the source code of those pages and not just the content on the page itself. Since it's not based purely on the written content of the page, this means if you're using a template of some kind or all your pages have a similar structure, they may end up being flagged as duplicate content. Pages can be marked as duplicates of each other when there isn't enough unique content on each page to distinguish them from each other.
The Moz tools have a 90% threshold for duplicate content so any pages with at least 90% of the same code will be flagged as duplicates of one another.
I've grabbed a few resources that may help:
Here is a Whiteboard Friday about duplicate content and some ways you can resolve it.
Here is an article from the Moz Learning Center regarding duplicate content.
Here is some information from Google re: duplicate content as well.At time of answering your query, you won't get a penalty for duplicate content, however anything you can do to help search engines understand what you content is about and to create value for your visitors, will support a strong content marketing and SEO strategy.
-
@eismarketing Hi Sharon!
Thanks so much for the great question! And so sorry for any confusion here.
Pages that are flagged as duplicate content are being assessed on the source code of those pages and not just the content on the page itself. Since it's not based purely on the written content of the page, this means if you're using a template of some kind or all your pages have a similar structure, they may end up being flagged as duplicate content. Pages can be marked as duplicates of each other when there isn't enough unique content on each page to distinguish them from each other.
The Moz tools have a 90% threshold for duplicate content so any pages with at least 90% of the same code will be flagged as duplicates of one another.
I've grabbed a few resources that may help:
Here is a Whiteboard Friday about duplicate content and some ways you can resolve it.
Here is an article from the Moz Learning Center regarding duplicate content.
Here is some information from Google re: duplicate content as well.At time of answering your query, you won't get a penalty for duplicate content, however anything you can do to help search engines understand what you content is about and to create value for your visitors, will support a strong content marketing and SEO strategy.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Duplicate Content
We have multiple collections being flagged as duplicate content - but I can't find where these duplications are coming from? The duplicate content has no introductory text, and no meta description. Please see examples:- This is the correct collection page:-
Technical SEO | | Caroline_Ardmoor
https://www.ardmoor.co.uk/collections/deerhunter This is the incorrect collection page:-
https://www.ardmoor.co.uk/collections/vendors How do I stop this incorrect page from showing?0 -
Unsolved What should I do with WordPress Blog homepage
Hi, I have a large WordPress blog with thousands of posts. By default, the blog homepage contains the excerpt of each posts. As there are so many posts, the homepage is paginated(Totally 1341 pages) I use siteliner to check and find a lot of duplicate contents on the blog homepage. So, what should I do with it? Should I noindex the homepage and all the paginated pages accordingly? Thank you
On-Page Optimization | | ccw0 -
Can you use no-index to counter duplicate content across separate domains?
Hi Moz Community, I have a client who is splitting out a sub brand from a company website to its own domain. They have lots of content around the theme and they want to migrate most of the content out to the new domain, but they also wanted to keep that content on the main site as the main site gets lots of traffic. My question is, as they want search traffic to go to the new site, but want to keep the best content on the original site too, so it can be found in the nav, if they no-index identical content on main site and index content on the new site will they still be penalised for duplicate content? Our advice has been to keep the thematic content on both sites but make them different enough so they are not considered duplicate - we routinely write the same blog post in 50 different ways for them but their Head of Web asked if the no-index is a route, which means they don't need to pay for and wait for brand new content? They are comfortable in losing traffic until the new domain gets traction. In theory, if they are telling Google not to index or rank the main site content, the new site shouldn't be penalised but I'm not confident giving that advice as I've never been asked to do this before. Thoughts?
Technical SEO | | Algorhythm_jT0 -
Unsolved Page Optimization Loop
When I am trying to optimise a page within MOZ this message box appears: dcf38be5-eff4-4317-87ab-ab560e8fea7c-image.png I click 'Track Keyword' and it just loops round with the same message over and over again. I have already added this particular keyword to be tracked but I still get the error message. Can anyone help?
Product Support | | Zigaflow0 -
Unsolved Almost every new page become Discovered - currently not indexed
Almost every new page that I create becomes Discovered - currently not indexed. It started a couple of months ago, before that all pages were indexed within a couple of weeks. Now there are pages that have not been indexed since the beginning of September. From a technical point of view, the pages are fine and acceptable for a Google bot. The pages are in the sitemap and have content. Basically, these are texts of 1000+ or 2000+ words. I've tried adding new content to pages and even transferring content to a new page with a different url. But in this way, I managed to index only a couple of pages. Has anyone encountered a similar problem?
Product Support | | roadlexx
Could it be that until September of this year, I hadn't added new content to the site for several months?
Please help, I am already losing my heart.0 -
Is the MOZ billing page down for everyone?
I am unable to update billing information as the link (https://moz.com/billing) resolves to a blank page. Please advise Thanks
Product Support | | RedSearch010 -
Issues with Page Grader Tool and competitor KW Rankings
I'm having two very frustrating issues with Moz: The page grader tool is not 'connecting' the correct keyword with the correct URL. For instance, if I want to rank for Dallas Motorcycle Accident Lawyer and create page of optimized content at Dallas.Zdfirm.com/Motorcycle-Accident, Moz doesn't grade THAT page. It grades Dallas.ZDFirm.com which to no surprise rates as an F. This is happening with both web sites on this account so much that the page grader tool is not delivering any value. My competitors keywords are not tracking properly. They are showing for "not in the top 50" for keywords that they are on the first page for. Again, this is for both domains on this account. Thanks, Brian
Product Support | | ZDAdmin0 -
Duplicate content on ecommerce sites
I just want to confirm something about duplicate content. On an eCommerce site, if the meta-titles, meta-descriptions and product descriptions are all unique, yet a big chunk at the bottom (featuring "why buy with us" etc) is copied across all product pages, would each page be penalised, or not indexed, for duplicate content? Does the whole page need to be a duplicate to be worried about this, or would this large chunk of text, bigger than the product description, have an effect on the page. If this would be a problem, what are some ways around it? Because the content is quite powerful, and is relavent to all products... Cheers,
Intermediate & Advanced SEO | | Creode0