Duplicate page error from SEOmoz
-
SEOmoz's Crawl Diagnostics is complaining about a duplicate page error. I'm trying to use a rel=canonical but maybe I'm not doing it right.
This page is the original, definitive version of the content:
https://www.borntosell.com/covered-call-newsletter/sent-2011-10-01
This page is an alias that points to it (each month the alias is changed to point to the then current issue):
https://www.borntosell.com/covered-call-newsletter/latest-issue
The alias page above contains this tag (which is also updated each month when a new issue comes out) in the section:
Is that not correct? Is the https (vs http) messing something up?
Thanks!
-
Thanks, Ryan.
My entire site is https. I 301 any http request to the https version. That works fine.
I also 301 any non-www to the www version. That works.
I'm not currently doing anything special with the trailing slash (or lack of). I guess I should 301 anything with a trailing slash to the non-slash version, rather than serve up slash and non-slash each as status 200.
Appreciate the guidance...
-
What would you expect to happen?
Well, when look at the current Q&A URL:
http://www.seomoz.org/q/duplicate-page-error-from-seomoz
now try adding a trailing slash to it
http://www.seomoz.org/q/duplicate-page-error-from-seomoz/
in this case the URL with the trailing slash is rejected, which is expected. What I don't expect is for the page to be redirected to the root Q&A page. Not sure why that was implemented here and it seems unusual to me.
An example of a site with the (close to) expected behavior is the Distilled site:
http://www.distilled.net/blog/seo/7-technical-seo-wins-for-web-developers/
If you try to remove the trailing slash, you will notice the URL is changed back to a URL with the trailing slash.
What I am a bit surprised about in the Distilled example is the redirected page shows a 200 header code. I believe it should display a 301 redirect from the page without the trailing slash to the page with it.
Overall I would say this is very nit-picky SEO but since the topic came up, it is relevant. Actually I am curious enough about this I will use my staff question this month on this topic
Should I 301 redirect the url with the slash to the url without the slash, or something else?
Yes. This issue is very similar to www vs non-www. Each page should have one version of a URL available and not more. It is not so important which you choose in as much as you make a decision and remain consistent.
The Distilled site chooses to end all URLs with a slash. That is a fine choice. SEOmoz chooses (as do I) to end category pages with a slash and actual web pages without a slash. Using this system if you look at a URL and it ends with a slash, you know you can go deeper. If the URL does not have a slash, you have reached the bottom.
Wow. This is the most time I have spent thinking about this little detail of SEO
-
Thanks for the response. A followup question.... when you say:
"when I enter the same URL with a trailing slash, the same page appears"
What would you expect to happen?
Should I 301 redirect the url with the slash to the url without the slash, or something else?
Thanks.
-
Your example of how the canonical tag is presented is perfect. You can verify your canonical tag is recognized using the MozBar Analyze Page > Page Attributes.
The https should not cause any issue.
Is it possible something else is causing the duplicate content warning? For example, I noticed when I enter the same URL with a trailing slash, the same page appears:
https://www.borntosell.com/covered-call-newsletter/latest-issue
https://www.borntosell.com/covered-call-newsletter/latest-issue/
Of course, both pages are canonicalized properly but it does show there is an issue on your site which should be addressed. Technically adding a slash to the end of a URL is a different page in much the same way that adding or removing the "www" subdomain offers a different page.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Error Code 804: HTTPS (SSL) Error Encountered
I'm seeing the following error in Moz as below. I have not seen any errors when crawling with different tools - is this common or is it something that needs to be looked at. SO far I only have info below. Assuming I would need to open a ticket with hosting provider for this? Thanks! Error Code 804: HTTPS (SSL) Error Encountered Your page requires an SSL security certificate to load (using HTTPS), but the Moz Crawler encountered an error when trying to load the certificate. Our crawler is pretty standard, so it's likely that other browsers and crawlers may also encounter this error. If you have this error on your homepage, it prevents the Moz crawler (and some search engines) from crawling the rest of your site.
Moz Pro | | w4rdy0 -
Duplicate Content/Missing Meta Description | Pages DO NOT EXISIT!
Hello all, For the last few months, Moz has been showing us that our site has roughly 2,000 duplicate content errors. Pages that were actually duplicate content, I took care of accordingly using best practice (301 redirects, canonicalization,etc.). Still remaining after these fixes were errors showing for pages that we have never created. Our homepage is www.primepay.com. An example of pages that are being shown as duplicate content is http://primepay.com/blog/%5BLink%20to%20-%20http:/www.primepay.com/en/payrollservices/payroll/payroll/payroll/online-payroll with a referring page of http://primepay.com/blog/%5BLink%20to%20-%20http:/www.primepay.com/en/payrollservices/payroll/payroll/online-payroll. Some of these are even now showing up as 403 and 404 errors. The only real page on our site within that URL strand is primepay.com/payroll or primepay.com/payroll/online-payroll. Therefore, I am not sure where Moz is getting these pages from. Another issue we are having in relation to duplicate content is that moz is showing old campaign url’s tacked on to our blog page i.e. http://primepay.com/blog?title=&page=2&utm_source=blog&utm_medium=blogCTA&utm_campaign=IRSblogpost&qt-blog_tabs=1. As of this morning, our duplicate content went from 2,000 to 18,000. I exported all of our crawl diagnostics data and looked to see what the referring pages were, and even they are not pages that we have created. When you click on these links, they take you to a random point in time from the homepage of our blog; some dating back to 2010. I checked our crawl stats in both Google and Bing’s Webmaster tool, and there are no duplicate content or 400 level errors being reporting from their crawl. My team is truly at a loss with trying to resolve this issue and any help with this matter would be greatly appreciated.
Moz Pro | | PrimePay0 -
Functionality of SEOmoz crawl page reports
I am trying to find a way to ask SEOmoz staff to answer this question because I think it is a functionality question so I checked SEOmoz pro resources. I also have had no responses in the Forum too it either. So here it is again. Thanks much for your consideration! Is it possible to configure the SEOMoz Rogerbot error-finding bot (that make the crawl diagnostic reports) to obey the instructions in the individual page headers and http://client.com/robots.txt file? For example, there is a page at http://truthbook.com/quotes/index.cfm month=5&day=14&year=2007 that has – in the header -
Moz Pro | | jimmyzig
<meta name="robots" content="noindex"> </meta name="robots" content="noindex"> This page is themed Quote of the Day page and is duplicated twice intentionally at http://truthbook.com/quotes/index.cfm?month=5&day=14&year=2004 and also at http://truthbook.com/quotes/index.cfm?month=5&day=14&year=2010 but they all have <meta name="robots" content="noindex"> in them. So Google should not see them as duplicates right. Google does not in Webmaster Tools.</meta name="robots" content="noindex"> So it should not be counted 3 times? But it seems to be? How do we gen a report of the actual pages shown in the report as dups so we can check? We do not believe Google sees it as a duplicate page but Roger appears too. Similarly, one can use http://truthbook.com/contemplative_prayer/ , here also the http://truthbook.com/robots.txt tells Google to stay clear. Yet we are showing thousands of dup. page content errors when Google Webmaster tools as shown only a few hundred configured as described. Anyone? Jim0 -
Too many on-page links
I received a warning in my most recent report for too many on-page links for the following page: http://www.fateyes.com/blog/. I can't figure out why this would be. I am counting between 60-70 including all pull downs, "read more's", archive, category and a few additional misc. links. Any ideas or suggestions on this? Or what I might do to rectify? Perhaps it's just an SEOmoz report blip... We currently don't have the post list rolling to additional pages so it's kind of passively set up to be endless, but it's in the works.
Moz Pro | | gfiedel0 -
How can I prevent errors of duplicate page content generated by my tags from my wordpress on-site blog platform?
When I add meta data and a canonical reference to my blog tags for my on-site blog which works using a wordpress.org template, Roger generates errors of duplicate content. How can I avoid this problem? I want to use up to 5 tags per post, with the same canonical reference and each campaign scan generates errors/warnings for me!
Moz Pro | | ZoeAlexander0 -
Transfering Page Authority
Hi, I have recently change my url architecture with site redesign and was just doing some analysis of the old and new pages. I seem to be losing a little bit of Organic Search because of it. As an example this old diving page in open site explorer shows a Page Authority of 46 whilst the new diving page shows a Page Authority of 22. I have a 301 redirect going from the old page to the new, but that seems to be quite a drop in Page Authority. Is there anything else I can be doing to improve upon it? Thanks, Adam
Moz Pro | | NaescentAdam0 -
Seomoz keyword research
Hi, does seomoz have keyword research tool? or any plan to have one in near future?
Moz Pro | | imsameer0 -
404 errors
I have a few 404 errors found using seomoz tool. It also shows the url, but I am not sure where in the site is it linking from. Is there a way to find out the origin of the 404 error. Thanks
Moz Pro | | Accounts0