Tool To Search For Duplicate Content
-
Hi
Is there such a tool that can be use to search a website for duplicate content?
Thanks
-
Although the Moz software is awesome, it only works to configure and setup campaigns if you are a PRO member which comes with a 99$ fee per month. This isn't for everyone unless they can use the software more than once.. I would suggest grabbing a few free tools online to use. You can check out : ScreamingFrog and/or Xenu Link Sleuth
Each will provide you with detailed reports to filter through and see content from your site. ScreamingFrog will provide you with data for up to 500 URL's for free. You will need to purchase the license to go deeper, depending on your site.
This one is a great for getting HTTP header checks and site wide duplicate content error notifications.
If you want to try a tool to verify online duplicate content - PageSpotter is a checking and monitoring tool.
A great post by Google Webmaster Center Blog about Duplicate Content and why you need to address it to help with your site.
If you plan to go the route of moving the site to a new domain/URL this is a great forum piece on the steps you need to plan and execute for a clean move.
Hope some of this helps you out!
-
In Moz Analytics:
Campaign > Search > Crawl Diagnostics.
That'll put you on the "Issues Overview" page, and if you go to the box with "High Priority Issues" Duplicate Page Content is one of them. You can click that, and it'll list your pages with Duplicate content, where the duplicates are, and some other useful information. If you've just set up your campaign, this might not show up for a week or so. Hope that helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What constitutes duplicate content on a page?
I am working on SEO for a Shopify store. Their products are very similar, hence the pages are so similar that Moz shows them as duplicate content. The only difference in the product pages is the title and model number. I am going to "go for the gold" and try re-writing all the product descriptions. It's incredibly difficult due to the products being nearly identical with just a minor variation. I know I could go down the road of just creating variants --- but the customer is not down for that. Here's my question: what constitutes duplicate content? 80% of the content, 90%???? If I can going to re-write the descriptions, what should I aim for? Thank you!
On-Page Optimization | | steve_linn1 -
Duplicate Page Titles
It seems as though we are being flagged for duplicate page titles when really they are slightly different. Is it better to remove the "dart board" or "dart board backboard" from all the product titles? We were doing this for optimal SEO - to rank for the search of "dart board" - but is it really hurting us? for example, our product titles are: Obama dart board backboard, Texas dart board backboard, Oklahoma dart board backboard, etc. Yet they are being flagged as duplicate titles.
On-Page Optimization | | DartsDecor0 -
Some Content The Same
Hello. I am about to publish some landing pages that target different industries that we are trying to market to. X for Accountants
On-Page Optimization | | smithandco
X for Financial Advisors
X for Fitness Trainers
X for X While a good portion of the content is unique on each page "the benefits of using X for accountants" some of the content on the page is duplicate which explains more about how our software works (the features), this will be the same content on every page. Is this considered duplicate content? What should I be aware of in term of Google rankings and penalties? Thanks,
David0 -
Duplicate content from category pages?
I have an ecommerce store with different categories for my products. Some products do appear in more than one category, is that an issue even if you end up on the same product page/link? Also, I have a "show all products" category, which I believe creates duplicate content too? What is your take on this? What can I do to solve this? Is it even an issue of duplicate content? All answers are very much appreciated!
On-Page Optimization | | danielpett0 -
How do you avoid duplicate content when you sell products that are produced by other manufacturers?
I have a packaging product site, and they sell products from various manufacturers. What can we do with the product detail pages? As of now, the client has copy pasted content straight from the "About" sections on the manufacturers' sites. Obviously, those manufacturers want my client to sell their products, and the products need to be described. How much of a no-no is this copy pasting, and how can I fix it?
On-Page Optimization | | lhc670 -
Ecommerce: content on category pages
I have to optimize some online Shops and after Panda I really don't know what to think about thin content on product overview pages anymore... used to be that we could improve our rankings easily just by adding 1-2 sentences on such a page. This always worked for non-overly competitive terms. Now It feels like it doesn't work any longer, but I couldn't put my finger on it and I don't have the resources to test. Here's an example of what I mean: http://www.geschenkidee.ch/wandtattoos/aus_aller_welt.html
On-Page Optimization | | zeepartner
I would add max. 3 lines of text directly over the product thumbnails. What do you think? Is it worth adding some text on a product overview page or do I not even have to bother post-Panda?0 -
Cross Domain Duplicate Content
Hi My client has a series of websies, one main website and several mini websites, articles are created and published daily and weekly, one will go on a the main website and the others on one, two, or three of the mini sites. To combat duplication, i only ever allow one article to be indexed (apply noindex to articles that i don't wanted indexed by google, so, if 3 sites have same article, 2 sites will have noindex tag added to head). I am not completely sure if this is ok, and whether there are any negative affects, apart from the articles tagged as noindex not being indexed. Are there any obvious issues? I am aware of the canonical link rel tag, and know that this can be used on the same domain, but can it be used cross domain, in place of the noindex tag? If so, is it exactly the same in structure as the 'same domain' canonical link rel tag? Thanks Matt
On-Page Optimization | | mattys0 -
Is the www and non www isue realy seen by Google as duplicate content?
I realy don't understand how Google could posibly devaluate a link because the site displays the same content with www and without www. I mean did somebody recently saw a devaluation of a domain because of this isue? I somehow can not belive this because it is the standard when geting a new webspace that the new website display the same content with and without www. Is a redirect realy necessary?
On-Page Optimization | | MichaelJanik0