Duplicate content issue in SEOmoz campaign.
-
Hi,
We are running a campaign for a website in SEOmoz.
We get a dup content issue warning:
http://www.oursite.com and http://www.oursite.com/ are being seen as 2 different urls.
Only difference among 2 urls is the trailing slash at the end of the second url.
Why is this happening? I was aware of www vs non www but never heard of an issue related to the slash.
Thanks for your help!
-
Nice to know this. I have had the same issue arise out of nowehre about week maybe two back. It took awhile but I found the same htaccess quick fix but it seems as if it was an seomoz alogorithim change up. Robot Roger works his butt off in the basment or so seomoz tells me he must have found some free time to switch up the campaign errors alogorithim.
-
#removes trailing slash
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteCond %{HTTP_HOST} !^.localhost$ [NC]
RewriteRule ^(.+)/$ http://%{HTTP_HOST}$1 [R=301,L]Above code segment removes trailing slashes, second code block is doing redirection from non-www to www.
In order for above code to work you will need to add two lines above it, telling Apache to enable rewrite module.
Options +FollowSymlinks
RewriteEngine onSo with that combined here is how your .htaccess file should look like
Options +FollowSymlinks
RewriteEngine on#removes trailing slash
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteCond %{HTTP_HOST} !^.localhost$ [NC]
RewriteRule ^(.+)/$ http://%{HTTP_HOST}$1 [R=301,L]If you are using non-Apache server such as IIS let me know and I send you configuration for it.
Kind regards
Bojan
-
So, this code:
#removes trailing slash
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteCond %{HTTP_HOST} !^.localhost$ [NC]
RewriteRule ^(.+)/$ http://%{HTTP_HOST}$1 [R=301,L]and this code:
REDIRECT to canonical url
RewriteCond %{HTTP_HOST} ^mysite.com [NC]
RewriteRule ^(.*)$ http://www.mysite.com/$1 [R=301,L]should be added to our .htaccess ?
Or is it just one of the two code blocks?
Thanks for your time!
-
From search engine perspective http://www.oursite.com and http://www.oursite.com/ are not the same thing.
This problem however is easily fixed, If you are using apache it's a matter of simple config file modification.
You can refer to http://www.seomoz.org/q/how-can-i-prevent-duplicate-content-between-www-page-com-and-www-page-com for more information.
Kind regards
Bojan
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Duplicate Contents in Order Pages of Multiple Products
Hi, I have a website containing 30 software products. Each product has an order page. The problem is that the layout and content of these 30 order pages are very similar, except for the product name, for example: https://www.datanumen.com/access-repair-order/
On-Page Optimization | | ccw
https://www.datanumen.com/outlook-repair-order/
https://www.datanumen.com/word-repair-order/ Siteliner has reports these pages as duplicate contents. I am thinking of noindex these pages. However, in such a case, if a user search for "DataNumen Outlook Repair order page", then he will not be able to see the order page of our product, which drives the revenue go away. So, how to deal with such a case? Thank you.1 -
Duplicate Content, http vs https
Hi All! I just discovered that a client of ours a duplicate content issue. Essentially they have approximately 20 pages that have an http and an https version. Is there a better way to handle this than a simple 301? Regards, Frank
On-Page Optimization | | FrankSweeney0 -
Solve duplicate content issues by using robots.txt
Hi, I have a primary website and beside that I also have some secondary websites with have same contents with primary website. This lead to duplicate content errors. Because of having many URL duplicate contents, so I want to use the robots.txt file to prevent google index the secondary websites to fix the duplicate content issue. Is it ok? Thank for any help!
On-Page Optimization | | JohnHuynh0 -
Duplicate content on domains we own
Hello! We are new to SEO and have a problem we have caused ourselves. We own two domains GoCentrix.com (old domain) and CallRingTalk.com (new domain that we want to SEO). The content was updated on both domains at about the same time. Both are identical with a few exceptions. Now that we are getting into SEO we now understand this to be a big issue. Is this a resolvable matter? At this point what is the best approach to handle this? So far we have considered a couple of options. 1. Change the copy, but on which site? Is one flagged as the original and the other duplicate? 2. Robots.txt noindex, nofollow on the old one. Any help is appreciated, thanks in advance!
On-Page Optimization | | CallRingTalk0 -
No Content on home page + rankings
If a home page has no content will it hurt the sites ability to rank? The interior pages will have content but not the home page. (See attached image) My client does not want content on the home page as he feels it will take away from the look and feel he wants to achieve. This website is actually 10 sites or locations in one as we intend to market each location (a total of 10) separately. In reality the home page is a doorway page to each separate location. I'd like feedback if possible as to the necessity or not, of content on the Home Page of this or any website. Will the lack of content hurt on the Homer Page hurt with SEO? Thanks
On-Page Optimization | | fun52dig
Gary Downey bobby-vans.jpg0 -
Duplicate Content for Spanish & English Product
Hi There, Our company provides training courses and I am looking to provide the Spanish version of a course that we already provide in English. As it is an e-commerce site, our landing page for the English version gives the full description of the course and all related details. Once the course is purchased, a flash based course launches within a player window and the student begins the course. For the Spanish version of the course, my target customers are English speaking supervisors purchasing the course for their Spanish speaking workers. So the landing page will still be in English (just like the English version of the course) with the same basic description, with the only content differences on that page being the inclusion of the fact that this course is in Spanish and a few details around that. The majority of the content on these two separate landing pages will be exactly the same, as the description for the overall course is the same, just that it's presented in a different language, so it needs to be 2 separate products. My fear is that Google will read this as duplicate content and I will be penalized for it. Is this a possibility or will Google know why I set it up this way and not penalize me? If that is a possibility, how should I go about doing this correctly? Thanks!
On-Page Optimization | | NiallTom0 -
Archive of content
Hi there, I have recently joined a company to look after the e-marketing side of things, anyway the company I work for have been writing articles for a website that they own for over 2 years, probably about 200 or so unique articles on that website, however over the past year or so there has been no contribution to this site and was wondering if it would be worthwhile transferring these article over to our blog?, as this is where all the attention is in terms of marketing etc Kind Regards,
On-Page Optimization | | Paul780 -
What should I do with these duplicate mass production?
Hi, I'm reviewing somebodies site and just realized that it's overflown with duplicates. Like these: <colgroup><col width="3496"></colgroup>
On-Page Optimization | | jjtech
| www.joannalark.com/store/products/24"-Sting.html |
| www.joannalark.com/store/products/24"-Sting.html?setCurrencyId=1 |
| www.joannalark.com/store/products/24"-Sting.html?setCurrencyId=6 |
| www.joannalark.com/store/products/24"-Sting.html?setCurrencyId=7 | It also produces something like this: | <colgroup><col width="3496"></colgroup>
| www.joannalark.com/store/pages/pages/pages/pages/pages.php?pageid=8 |
| www.joannalark.com/store/pages/pages/pages/pages/pages/pages.php?pageid=8 |
| www.joannalark.com/store/pages/pages/pages/pages/pages/pages/pages.php?pageid=8 |
| www.joannalark.com/store/pages/pages/pages/pages/pages/pages/pages/pages.php?pageid=8 |
| www.joannalark.com/store/pages/pages/pages/pages/pages/pages/pages/pages/pages.php?pageid=8 |
| www.joannalark.com/store/pages/pages/pages/pages/pages/pages/pages/pages/pages/pages.php?pageid=8 | |
|
|
|
|
| I don't know what to do with that and would appreciate any help Thanks, JJ <colgroup><col width="3496"></colgroup>
| |
| |
| |
| |
| |
| |0