Duplicate Page and Title Issues
-
On the last crawl, we received errors for duplicate page titles and some duplicate content pages.
Here is the issue:
We went through our page titles that were marked as duplicate and changed them to make sure their titles were different. However, we just received a new crawl this week and it is saying there are even more duplicate page title errors detected than before. We're wondering if this is a problem with just us or if it has been happening to other Moz users.
As for the duplicate content pages, what is the best way to approach this and see what content is being looked at as a "duplicate" set?
-
I am being told I have hundreds of duplicate titles and content on my site. It's not possible. Not only do I only have 120ish posts on my site and they all have different titles, but google console shows me that no on on the web is claiming my posts as theirs (ie they are not saying they are the originals, etc.) So what the heck is the issue? Why am I being told that posts that are NOT duplicate of anything are duplicate content and that I have a bunch of duplicate titles when NONE OF MY titles are duplicates of any other title?????????
And, how can I have 400 pieces of duplicate content when I only have 120 blog posts??
Please someone help me with this
-
Always glad to help!
-
Thank you for your help!
-
Hi there!
I took a look at your campaign and it seems that we crawled a lot more page of the site this week in general than we did the previous week. Two weeks ago, we crawled about 500 pages and this week the crawl jumped up to 2800. So it isn't that there are more duplicate pages on your site now, it is just that we are able to crawl more pages now than we were before, which led to us finding even more duplicate pages that had not been reported before.
As for why we are crawling so many more pages, it could be for a few reasons. If you made changes to the links on your site, the page hierarchy of the site, or if you remove noindex tags or updated the robots.txt file for the site, those things could all affect how we are able to crawl the site.
I hope this helps! Please let me know if I can help you with anything else.
Chiaryn
Help Team Sensei -
Hey There!
I responded to your support request with more information on how we view canonicals. I hope it was helpful!
If you can send me examples of pages that you believe are being counted incorrectly, that will help me determine if there is an issue with the crawl or if the pages correctly fall into how we determine duplicates based on the canonical tags.
I look forward to hearing back from you there soon!
Chiaryn
Help Team Sensei -
They have different purposes, but all relating to preventing the same page from showing duplicate content because of the different ways a URL can be written. There is nothing on this page to show that using a canonical tag can take two different pages and remove the similar content. The purpose of the canonical tag is to set the preferred URL for one page.
-
The problem is, our content is unique to each page and post. Yet they still have been coming up duplicated. I'll have to try Netrepid's google searching suggestion to double check these.
-
I would remove the domain name when you use the query.
moz keyword research in the united states best practice gets a much different SERP than keyword research in the united states best practice.
If you are trying to get a pure SERP result than you shouldn't use your domain name. That will tell you if there are any other search results in the web. If you want to find duplicate content on your site use copyscape.com or go to GWT and look for internal duplicate content.
Again, not only copy creates a duplicate content message. It is having an off html to text ratio, repetitive links in the HTML with not enough copy to balance it out. If Moz is reading a duplicate content error, and the number is increasing week to week I wouldn't discredit the finding simply because you don't understand why the error is occurring. The canonical tag won't prevent two different URLs from showing duplicate content. If you want to do that, no follow one of the URLs. That isn't best practice though, best practice is to fix the copy.
-
Hey Monica... canonical tagging can be used for a lot more than just 'www' or non-www:
-
Yeh, the weird thing I am noticing is that the canonical tags are already present on this domain, and it's not picking up ALL of the pages with canonical as duplicates.
I'm not really sure what's going on, but when in doubt, I always Google the following query:
site:domain intext:block of text unique to that page
If there is a duplicate content issue, Google should tell you that by showing more than one result. If it shows only one, then Google is reading your code right.
I know we all love Moz and want them to show we have no errors on our sites, but at the end of the day... don't we really want Google to find no issues with our sites, not Moz?
-
Canonical tags just point non www URL address to www addresses. It tells the engines that whether or not the WWW is used, the two URLs are the same page. It will only solve the duplicate content errors if that is in fact what is causing the error. If the actual cause is duplicate content the only way to solve it is to write unique copy.
-
Thank you for that information!
-
No Magento. We were debating the use of Canonical tags ourself.
-
I'm noticing a similar issue for an online store I consult for. We added canonical tags to all product pages and category pages, and Moz doesn't appear to be correctly attributing them.
Are you using a Magento store by chance?
-
Depending on when you made the changes, it could just be that they weren't fixed in time for the next crawl. Fixing these duplicate titles are really important for your SEO.
Open the medium priority issues and set it to duplicate page titles only. When you do that you will see which titles are duplicate. Sometimes there are more than one duplicate title so make sure you completely expand each line. I would make sure I go back into all of them and see if what is showing as duplicate on the crawl report is still the same information on your title tags. If it matches, then those pages need to be changed. If the titles are different, then wait another week and just see if the timing was off somehow.
If you have pages with duplicate content there could be a few things triggering it. There could be a too much of the same HTML and not enough text to make the pages look different. The content on the pages could be very thin, and very similar. The best way to offset duplicate page errors on your site is to get original, informative, unique content on those pages. You can set your crawl report to high priority errors, then select duplicate page content. You can then look at all of the duplicate pages side by side to determine if you can get unique content on those pages. If you are getting duplicate page errors for the same web page, one with a WWW and one without, then check to make sure your REL Canonical tags are in place and functioning properly. If the pages are different then you need to get great content up.
-
Hi there,
See here - I think Moz Analytics/PRO don't process rel=prev/next properly, so they may give false alarms on those pages, even if the titles are properly implemented.
Cheers
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Top Pages and Tool Bar Not Crawling Internal Pages and Links
Hello, We’re having two issues with our Moz tools and we’re not sure what’s causing them and whether they are related. The Moz Bar isn’t highlighting some of our internal links (including navigation links). The Top Pages Report in Open Site Explorer is only picking up the homepage and a couple error pages (none of the internal pages). The full Crawl Report is picking up everything though. Could a potential cause of both these issues be the Title attribute in some our links? – We use <a <="" span="">title="Example" href="link"></a> <a <="" span="">Or is this most likely from something else blocking the crawler from accessing our links/pages? Google Search Console does seem to be picking up the links in the navigation and everything is indexed/rendered correctly so we also didn’t know if this is something that could be issue. Any insight or help would be appreciated. Please let us know if there are any details we could provide that might help. Looking forward to hearing from all of you! Thank you in advance. Best,</a>
Moz Bar | | Ben-R0 -
Page Authority drop to Zero with new Moz crawl
My Site having page authority about 15 to 17 and i added many new pages in end of November. Everything is fine in December Moz Crawl update (Page Authority - Domain Authority) but in recent update my DA id drop 3 points and all my pages authority vanished drop to 1. Can anyone help me out to understand whats going on there!!!
Moz Bar | | signsny0 -
Re On-Page Grader
One of the pages I'm trying to optimise is achieving an 'A' grade, however all the ticks are black not green as I've seen on other page grade. Why is this? Help much appreciated. Thanks
Moz Bar | | seoman100 -
Unusual "internal links" causing SEO issues?
Hi all, I'm working on an ecommerce site which has been around for almost 20 years. Over the years it has started to suffer in Google's search results and the decision was recently made to completely overhaul the site. We're now very happy with the website's design, and care was taken to maintain page rank via 301s, etc. However, the site has just fallen off the bottom of Google's first search result page (for the first time in years) for our main keyword. I signed up here in the hope of using Moz's SEO tools to help us return to our former glory, but I'm seeing some confusing results: I've run a crawl test on our site, as well as on our two biggest competitors. One thing that really stood out was that we have over 1000 "internal links" to our homepage, whereas our competitors both have around 20-30 (both of which appear at the top of the first SR page). Since the rest of the "on-page SEO" looks OK, I suspect that this could be causing our problems, but I don't understand where this "internal links" number is coming from. Links to our competitor's homepage appear in the navigation bar on every single one of their product pages (which they have about 500 of), yet your report only claims that they have 30 links. The only link to the homepage appears in the site's main navigation bar (which obviously appears on every product page - exactly as it does on our competitors' sites). Additionally, almost every other page on our site apparently has 0 "internal links" and 0 page authority. Is this a problem with Moz's crawl test tool, or is our site actually at fault? The above has been asked directly to Moz staff, but I haven't had a reply. I'd hugely appreciate any words of wisdom from the community. Many thanks in advance. Nick
Moz Bar | | nick45010 -
I'm getting a Crawl error 605 Page Banned by robots.txt, X-Robots-Tag HTTP Header, or Meta Robots Tag
The website is www.bigbluem.com and is a wordpress site. I'm getting the following error: 605 Page Banned by robots.txt, X-Robots-Tag HTTP Header, or Meta Robots Tag But what is weird is the domain it lists below that is http://None/BigBlueM.com Any advice?
Moz Bar | | TumbleweedPDX1 -
My product pages have no weight / links from root domains with the Moz tool bar
Hi, When I view my home page (http://www.arkwildlife.co.uk) with the Moz toolbar, I see a good PA and a good amount of links from root domains. As I go down the site, it seems to get worse. The category pages (http://www.arkwildlife.co.uk/Category/0/Straight_Foods.html) have a little but not much and then from this point onwards, it's nothing. The product page (http://www.arkwildlife.co.uk/Item/Straight_Foods~Sunflower_Seeds/SUNH/Premium_Sunflower_Hearts.html) is reporting to have no root domain links but I am not sure why. Interestingly, when I click through to a review page (http://www.arkwildlife.co.uk/StockReview/0/SUNH/0/Premium_Sunflower_Hearts.html) it does have some juice. Would anyone be able help on why this is happening and what I need to be looking at in order to resolve it please? EDIT: I've been looking at the hyperlinks and notice something odd. If I review the score with the first link below, it gives a score of 1, but the second gives a PA of 13 with one root domain linked. 1:http://www.arkwildlife.co.uk/Item/Straight_Foods~Sunflower_Seeds/SUNH/Premium_Sunflower_Hearts.html 2:http://www.arkwildlife.co.uk/Item/Straight_Foods%7ESunflower_Seeds/SUNH/Premium_Sunflower_Hearts.html Please note the "%7E" instead of the "~" in the URL. The browser appears to show the ~ character no matter what but the rank of the page changes. I don't understand what the Moz toolbar is doing with this. Note: This behaviour only happens in Mozilla Firefox, in chrome both the rankings are zero for each URL. Many Thanks.
Moz Bar | | nawgie0 -
On Page Grader Returning Large # of Keywords
When using the on-page grader the results show the below for a page with a specific keyword in the body only 5 times : We found this keyword used 1100 times. Any Idea why this would be showing such a high number? The keywords are in Thai language but there is a space before and after the keyword. Thanks.
Moz Bar | | brettjohn670 -
Moz not crawling opencart product pages
hi, i have waited for over 2 weeks now and the crawler only got 8 pages, and is not getting all the open cart pages and products. any idea of what can be wrong? im using joomla 2.5.11 and mijoshop 2.0.5 (which uses opencart 1.5.5.1). thanks
Moz Bar | | marlvass10