Duplicate page error from SEOmoz
-
SEOmoz's Crawl Diagnostics is complaining about a duplicate page error. I'm trying to use a rel=canonical but maybe I'm not doing it right.
This page is the original, definitive version of the content:
https://www.borntosell.com/covered-call-newsletter/sent-2011-10-01
This page is an alias that points to it (each month the alias is changed to point to the then current issue):
https://www.borntosell.com/covered-call-newsletter/latest-issue
The alias page above contains this tag (which is also updated each month when a new issue comes out) in the section:
Is that not correct? Is the https (vs http) messing something up?
Thanks!
-
Thanks, Ryan.
My entire site is https. I 301 any http request to the https version. That works fine.
I also 301 any non-www to the www version. That works.
I'm not currently doing anything special with the trailing slash (or lack of). I guess I should 301 anything with a trailing slash to the non-slash version, rather than serve up slash and non-slash each as status 200.
Appreciate the guidance...
-
What would you expect to happen?
Well, when look at the current Q&A URL:
http://www.seomoz.org/q/duplicate-page-error-from-seomoz
now try adding a trailing slash to it
http://www.seomoz.org/q/duplicate-page-error-from-seomoz/
in this case the URL with the trailing slash is rejected, which is expected. What I don't expect is for the page to be redirected to the root Q&A page. Not sure why that was implemented here and it seems unusual to me.
An example of a site with the (close to) expected behavior is the Distilled site:
http://www.distilled.net/blog/seo/7-technical-seo-wins-for-web-developers/
If you try to remove the trailing slash, you will notice the URL is changed back to a URL with the trailing slash.
What I am a bit surprised about in the Distilled example is the redirected page shows a 200 header code. I believe it should display a 301 redirect from the page without the trailing slash to the page with it.
Overall I would say this is very nit-picky SEO but since the topic came up, it is relevant. Actually I am curious enough about this I will use my staff question this month on this topic
Should I 301 redirect the url with the slash to the url without the slash, or something else?
Yes. This issue is very similar to www vs non-www. Each page should have one version of a URL available and not more. It is not so important which you choose in as much as you make a decision and remain consistent.
The Distilled site chooses to end all URLs with a slash. That is a fine choice. SEOmoz chooses (as do I) to end category pages with a slash and actual web pages without a slash. Using this system if you look at a URL and it ends with a slash, you know you can go deeper. If the URL does not have a slash, you have reached the bottom.
Wow. This is the most time I have spent thinking about this little detail of SEO
-
Thanks for the response. A followup question.... when you say:
"when I enter the same URL with a trailing slash, the same page appears"
What would you expect to happen?
Should I 301 redirect the url with the slash to the url without the slash, or something else?
Thanks.
-
Your example of how the canonical tag is presented is perfect. You can verify your canonical tag is recognized using the MozBar Analyze Page > Page Attributes.
The https should not cause any issue.
Is it possible something else is causing the duplicate content warning? For example, I noticed when I enter the same URL with a trailing slash, the same page appears:
https://www.borntosell.com/covered-call-newsletter/latest-issue
https://www.borntosell.com/covered-call-newsletter/latest-issue/
Of course, both pages are canonicalized properly but it does show there is an issue on your site which should be addressed. Technically adding a slash to the end of a URL is a different page in much the same way that adding or removing the "www" subdomain offers a different page.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why is my page rank disapointing
Hi fairly new here, so just getting used to everything one questions please. Just ran a crawl test of the website and this page http://www.livingphilosophy.org.uk/teaching-philosophy/index.htm came back with a page authority of 1. Other pages have a rank of 18 through 26 scratched my head for a few hours and came up with no ideas. thanks andy
Moz Pro | | livingphilosophy0 -
Duplicate URLs
A campaign that I ran said that my client's site had some 47,000+ duplicate pages and titles. I was wondering how I can possibly set that many 301 redirects, but a Moz help engineer said it has a lot to do with session IDs. See this set of duplicate URLs: http://www.lumberliquidators.com/ll/c/engineered-hardwood-flooring (clearly the main URL for the page)
Moz Pro | | AlanJacob
http://www.lumberliquidators.com/ll/c/engineered-hardwood-flooring?PIPELINE_SESSION_ID=0ac00a2e0ad53eb90cb0b0304d178fc1
http://www.lumberliquidators.com/ll/c/engineered-hardwood-flooring?PIPELINE_SESSION_ID=0ac3039d0ad4af2720b3ccd2238547ab
http://www.lumberliquidators.com/ll/c/engineered-hardwood-flooring?PIPELINE_SESSION_ID=0ac071ed0ad4af292684b0746931158f To a crawler, that looks like 4 different pages, when it's clear that they're actually all different URLs for the same page. I was wondering if some of you, maybe with experience in site architecture, would have insight into how to address this issue? Thanks Alan0 -
How to know exactly which page links to a 404 page on my website?
Hi Moz users, Sometimes I get 404 crawl errors using Moz Pro and when my website has a few dozen pages it is hard for me to find the original page that links to a 404 page. Is there a way to find this automatically using Moz or do I have to look for it manually? I just need to find the original link and delete it to fix my 404 issue. Please let me know thank you for you help. -Marc
Moz Pro | | marcandre0 -
SEOMOZ Support: Domain Name Change in SEOMOZ
My client is changing their domain name. They are redirecting (301) all of their URLs to the new domain. Do I need to do anything in SEOMOZ to preserve the campaign?
Moz Pro | | DynoSaur0 -
How does SEOmoz pull its duplicate page title and content information?
I ask because I am getting errors based on URLs that do not even exist on our site. For example: http://www.robots.com/applications/abb/panasonic/robots this URL does not even exist for our site, but somehow it is listed in the error section of page title duplication tool. http://www.robots.com/applications/ exists, but there is no place to get to an ABB or a Panasonic robot from this page, not to mention an ABB/Panasonic (which for sure does not exist). ?? We have quite a few of these out there and just wondering how to find out where the link is coming from. When we checked our URLs through Integrity, links like the one listed above (which we had 29 of them listed) that do not show up. Thoughts? Thanks! Janelle
Moz Pro | | jwanner0 -
Canonical URLs and Duplicate Page Content
My website (doctor directory) is getting a lot of duplicate page content & duplicate page title warnings from SEOmoz. The pages that are getting the warnings are doctors profiles which can be accessed at three different URLs. Problem is this should be handled by the canonical tag on the pages. So example below, all three open the same page: https://www.arzttermine.de/arzt/dr-sara-danesh/ https://www.arzttermine.de/arzt/dr-sara-danesh/gkv https://www.arzttermine.de/arzt/dr-sara-danesh/pkv Here's our canonical tag (on line 34): rel="canonical" href="http://www.arzttermine.de/arzt/dr-sara-danesh" /> So why is SEO moz crawling the page? We are getting hundreds of errors from this - and yet Google doesn't have any of the duplicate URLs indexed...
Moz Pro | | thomashillard0 -
How come when I export a error list I can only export the first page?
I am working on fixing the 4xx errors. I have found the easiest way to do this would be to export the list, print it out, and check off the ones i've fixed. The site only lets me export the first page. We'll appreciate any help. Thanks, Ryan D. Gran --Not sure what category this question belongs in so selected SEOmoz Tools--
Moz Pro | | dggusmc0