How do I interpret Duplicate Content in a Crawl Report, when it only gives me a URL? How do I know what is duplicated on that page somewhere else?
-
I need help interpreting the Crawl Report for Duplicate Content. It gives me the URLs of pages that have duplicate content, but how do I know what content exactly is duplicated elsewhere? And how do I figure out where it is duplicated? Also, are there Moz Analytics articles or videos teaching you how to use each component of the analytics programs? Thanks!
-
When on the crawl diagnostic page there is the column that says the number of duplicate URLs. If you hover over the little i symbol then the popup will show the other URLs. Also, if you download the CSV of the report there is a column called Duplicate Page Content which lists the URLs.
Edit: Unless I completely misinterpreted what you were asking and you want to know how to find out the exact words or meta that is the same across them all. In which case, Moz usually only picks up duplication of Title Tags, Meta Description and the actually page content. So if they're flagged as duplicates its just a matter of reading the pages or giving them a quick glance to see how similar they are.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Huge fluctuation reported by GSC for US Desktop for one keyword
Hi, I'm seeing a huge rank fluctuation reported by GSC (all rank trackers reported stable rank) for one of our pages, one particular keyword, in one particular country (US), and only Desktop (not Mobile). Is anyone else encountering a similar case? More details: huge rank fluctuation reported by GSC in the US, stable in other countries (since Oct 7th) all rank tracking service reported stable top rank in US cities (as well as our own friend's testing across the country) only happen to 1 keyword and its close variation (other keywords that the page also ranks for are quite stable) only observed fluctuation for Desktop, while Mobile is stable in those low-ranked days, the average CTR is only slightly lower than normal days Does anyone have any idea what could this be? Should I trust GSC's fluctuation or the rank tracking service's stable top rank? 0ee0a6cdd6cfc194e670ba5628d04e3d7c8253a35fdbf33291018aa4f528fd1e.png
Getting Started | | sandiego-seo0 -
Moz Not Crawling Angular SPA
I have a client that just launched a redesigned website using Angular as a single page app. Google appears to be able to crawl the site just fine, but Moz crawl is only finding one page. We have updated the htaccess to allow for Rogerbot and Dotbot, but still unable to crawl any pages other than the home page. Does anyone have experience with this or ideas of why it won't crawl all pages, and how to allow for Moz to crawl all pages? There is a sitemap with approx. 390 pages. Thanks!
Getting Started | | PIN_Celler1 -
Standard Syntax in robots.txt doesn't prevent Moz bot from crawling
A client is getting many false positive site crawl errors for things like duplicate titles and duplicate content on pages that include /tag/ in the URL. An example is https://needquest.com/place_tag/autism-spectrum-disorder/page/4/ To resolve this we have set up a disallow statement in the robots.txt file that says
Getting Started | | btreloar
Disallow: /page/ For some reason this appears not to work, as the site crawl errors continue to list pages like this. Does anyone understand why that would be and what we need to do to properly disallow crawling these pages?0 -
How to have MOZ site crawl pre-launch
Hi, Our new website is about to launch. We would love to have moz.com SITE CRAWL our site before launch. For issues like "missing meta description" and everything else that moz.com checks. We would love to do it before we launch. The new site is currently on a different domain than our live site. example.com <-- this is our live site. new-site.com <-- this is our "staging" server with the new site. We have a long running campaign for example.com Do we need to create a new campain for new-site.com ? Or is there some other simpler way? When we launch we will switch the site from new-site.com to example.com .. example.com will be the address for the new site.. Any ideas or suggestions? best practices? edit Forgot to say thank you for your help and input 🙂
Getting Started | | tandvarden0 -
Is Search Visibility giving a fair comparison with your competition?
I dived into the Search Visibility metric and what it actually says. In short, I believe it to be an aggregated score for all keywords targeted. However, our list of targeted keywords also include specific 'branded' keywords (and e.g. names of company leaders), which (presumably) aren't targeted by our competition. So what does the comparison with our competitors (i.e. Search Visbility x Competition graph) actually tell us? Isn't it giving a skewed impression? (Or are keywords labeled as 'branded' not taken into consideration in the Search Visibility metric?)
Getting Started | | BentoPres0 -
Fixing Non-Valid URL - Oops! This does not appear to be a valid URL. Please try again.
Edit - Turns out I can't delete a question. I ended up finding out I'm supposed to email the Moz team at help@moz.com. I did a search regarding the issue, but I only found answers for people using AWS. The results say the .htaccess isn't setup correctly, but I don't know how to fix that file. Any help would be greatly appreciated. Thanks.
Getting Started | | MattHarris0 -
My site is not being fully crawled
Our site has been crawled several times by RogerBot but each time only 6 pages are crawled even though we have more than 100 pages. Do I need to submit my sitemap.xml to Moz?
Getting Started | | Scurri0 -
Oops! This doesn't appear to be a valid URL. Please try again.
Hi, I just started with using MOZ and at my first attemp I can not start a new campaign because my url doesn't appear to be valid.. I tried http://www.mydomain.nl , www.mydomain.nl and mydomain.nl.. It's a Dutch extension (.nl). Can this be the problem? Excuse me my spelling and typo's. I'm Dutch 🙂
Getting Started | | SWP0