Why is there duplicates of my domain
-
When viewing crawl diagnostics in SEOmoz I can see both "www.website.com" and a truncated version "website.com" is this normal and why is it showing (I do not have duplicates of my site on the server)?
E.g.:
-
Hi All,
I have just altered my Google Webmaster tools in the Config (as per Geoff's advice above) and that appears to be fine for now. However, I have also updated my ".htaccess" file dong a 301 redirect, details below:
Options +FollowSymLinks
RewriteEngine onRewriteCond %{HTTP_HOST} !^www. [NC]
RewriteRule ^ http://www.%{HTTP_HOST}%{REQUEST_URI} [L,R=301]I also have recently changed my pages from .html to .php do I redirect by using this code as I want all old links to now refer to the .php file:
RewriteRule (.*).html$ /$1.php [R=301,L]
Lastly, Thomas on the canonical side of things, is it necessary for me to implement this in the Head?
How can I see if the work completed is correct or check that it works?
Paul.
-
Ok, I have implemented the Google Webmaster redirect. and now I have tried the edit to the .htaccess file trying both options below with no success.
Option 1:
AddHandler php-stable .php
RewriteEngine On
RewriteCond %{HTTP_HOST} !^www.RewriteRule ^(.*)$ http://www.%{HTTP_HOST}/$1 [R=301,L]Option 2:
AddHandler php-stable .php
Options +FollowSymLinks
RewriteEngine on
RewriteRule (.*) http://www.klinehimalaya.com/$1 [R=301,L]Neither seem to be working when viewed here:
http://anythinghere.klinehimalaya.com/Please help.
Thanks
-
Hey Mat,
Another question. If I have changed a page address from:
http://www.klinehimalaya.com/packages.html to
http://www.klinehimalaya.com/packages.phpwill I also need to redirect the pages I have changed from .html to .php or is this not needed because I have not changed the file name prior to the prefix?
Thanks.
Paul.
-
You can set the preferred domain just like Geoff mentioned. But basically since you have a www version and a non www version it can be seen as duplicate content. Although the site is only one website and changes will appear on each the URL structure changes for depending on if you use the www or non www and therefore it looks like duplicate content.
-
I have checked out your website we you may not have implemented the 301 redirect correctly. In addition you should use Google Webmaster tools along with
rel="canonical"
http://www.seomoz.org/blog/how-to-advanced-relcanonical-http-headers
http://support.google.com/webmasters/bin/answer.py?hl=en&answer=139394
Add a
rel="canonical"
link to the section of the non-canonical version of each HTML page.To specify a canonical link to the page http://www.example.com/product.php?item=swedish-fish, create a element as follows:
Copy this link into the section of all non-canonical versions of the page, such as http://www.example.com/product.php?item=swedish-fish&sort=price.
If you publish content on both http://www.example.com/product.php?item=swedish-fish and https://www.example.com/product.php?item=swedish-fish, you can specify the canonical version of the page. Create the element:
Add this link to the section of https://www.example.com/product.php?item=swedish-fish.
-
Hi,
If I was you I would go into Google Webmaster tools and verify both versions of the site, then go to Configuration >> Setting >> Preferred domain and tell Google your preference.
You will need to do this with both verified versions of the domain. You can then delete the listing for the one you do not want
You will only need one Google Verification code.
That will sort the issue with Google
Geoff
-
You have fixed the redirect loop, but the initial problem still exists. With the urgent issue now fixed (I can see the site now!) let's look at the problem:
You don't actually have a live problem at the moment, so any fix here will not improve your results. However you have a potential problem - one that could occur and cause you problems later. It's not hard to fix, so it is good to get it done.
Your server (like many) is set up to serve the same files to both klinehimalaya.com and www.klinehimalaya.com, which are technically different addresses. If google followed a link to klinehimalaya.com and a link to www.klinehimalaya.com if would find the content at two seperate places and could index both and consider them to be duplicate. Yes... all those PHDs and Google is still that stupid.
What you need to do (and I think you were trying to do this) is to pick one version of that address as the one that you are going to use. You can then redirect traffic from the other version to the chosen version.
In fact anythinghere.klinehimalaya.com is also serving up the same site, so you should fix the lot in one go.
If you are running apache (most sites are) then you can do this with an .htaccess redirect . There is a good example of how to do this at the top of this page: http://dense13.com/blog/2008/02/27/redirecting-non-www-to-www-with-htaccess/
In short it checks to see whether the address being loaded starts with www. . If it doesn't then it loads that version via a 301 redirect.
The issue Ross has pointed out is separate and not fixed by this. You should do both.
I hope that helps.
-
You are linking to your home page via your logo in the header.
However you are linking to this address http://www.klinehimalaya.com/index.php try linking to this address http://www.klinehimalaya.com/
This will remove your duplicate content issue.
-
Think I just fixed the redirect, but I still have an issue in SEOmoz where it is still pulling up both references to:
http://www.klinehimalaya.com/index.php
klinehimalaya.com/index.phpApparently this will effect my SEO efforts, hot to fix!!!
Thanks all!
-
I tried to look at this for you, but you have some issues on your site that are stopping me viewing it completely.
Both klinehimalaya.com and www.klinehimalaya.com create an infinite loop that prevents the page loading. klinehimalaya.com is correctly 301ing to www.klinehimalaya.com
However www.klinehimalaya.com is redirecting to itself.
You need to fix that URGENTLY. Start by looking at your htaccess file.
-
You need to do a 301 redirect
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Spammers created bad links to old hacked domain, now redirected to our new domain. Advice?
My client had an old site hacked (let's call it "myolddomain.com") and the hackers created many links in other hacked sites with links such as http://myolddomain.com/styless.asp?jordan-12-taxi-kids-cheap-T8927.html The old myolddomain.com site was redirected to a different new site since then, but we still see over a thousand spam links showing up in the new site's Search Console 404 crawl errors report. Also, using the links: operator in google search, we see many results of spam links. Should we be worried about these bad links pointing to our old site and redirecting to 404s on the new site? What is the best recommendation to clean them up? Ignore? 410s? Other? I'm seeing conflicting advice out there. The old site is hosted by the client's previous web developer who doesn't want to clean anything up on their end without an ongoing hosting contract. So beyond turning redirects on or off, the client doesn't want to pay for any additional hosting. So we don't have much control over anything related to "myolddomain.com". 😞 Thanks in advance for any assistance!
Technical SEO | | usDragons0 -
When is Duplicate Content Duplicate Content
Hi, I was wondering exactly when duplicate content is duplicate content? Is it always when it is word-for-word or if it is similar? For example, we currently have an information page and I would like to add a FAQ to the website. There is, however, a crossover with the content and some of it is repeated. However, it is not written word for word. Could you please advise me? Thanks a lot Tom
Technical SEO | | National-Homebuyers0 -
Duplicate Content Mystery
Hi Moz community! I have an ongoing duplicate mystery going on here and I'm hoping someone here can answer my question. We have an Ecommerce site that has a variety of product pages and category pages. There are Rel canonicals in place, along with parameters in GWT, and there are also URL rewrites. Here are some scenarios, maybe you can give insight as to what’s exactly going on and how to fix it. All the duplicates look to be coming from category pages specifically. For example:
Technical SEO | | Ecom-Team-Access
This link re-writes: http://www.incipio.com/cases/tablet-cases/amazon-kindle-cases-sleeves.html?cat=407&color=152&price=20- To: http://www.incipio.com/cases/tablet-cases/amazon-kindle-cases-sleeves.html The rel canonical tag looks like this: http://www.incipio.com/cases/tablet-cases/amazon-kindle-cases-sleeves.html" /> The CONTENT is different, but the URLs are the same. It thinks that the product category view is the same as the all products view, even though there is a canonical in there telling it which one is the original. Some of them don’t have anything to do with each other. Take a look: Link identified as duplicate: http://www.incipio.com/cases/smartphone-cases/htc-smartphone-cases/htc-windows-phone-8x-cases.html?color=27&price=20- Link this is a duplicate of: http://www.incipio.com/cases/macbook-cases/macbook-pro-13in-cases.html Any idea as to what could be happening here?0 -
Duplicate content pages on different domains, best practice?
Hi, We are running directory sites on different domains of different countries (we have the country name in the domain name of each site) and we have the same static page on each one, well, we have more of them but I would like to exemplify one static page for the sake of simplicity. So we have http://firstcountry.com/faq.html, http://secondcountry.com/faq.html and so on for 6-7 sites, faq.html from one country and the other have 94% similarity when checked against duplicate content. We would like an alternative approach to canonical cause the content couldn´t belong to only one of this sites, it belongs to all. Second option would be unindex all but one country. It´s syndicated content but we cannot link back to the source cause there is none. Thanks for taking the time in reading this.
Technical SEO | | seosogood0 -
Unavoidable duplicate page
Hi, I have an issue where I need to duplicate content on a new site that I am launching. Visitors to the site need to think that product x is part of two different services. e.g. domain.com/service1/product-x domain.com/service2/product-x Re-writing content for product x for each service section is not an option but possibly I could get over that only one product-x page is indexed by search engines. What's the best way to do this? Any advice would be appreciated. Thanks, Stuart
Technical SEO | | Stuart260 -
I've consolidated other domains to a single one with 301 redirects, yet the new domain authority in MOZ is much less that the redirected ones. Is that right?
I'm trying to increase the domain authority of my main site, so decided to consolidate other sites. One of the other sites has a much higher domain authority, but I don't know why after a 301 redirect, the new site's domain authority hasn't changed on over a month. Does MOZ take account of thes types of things?
Technical SEO | | bytecgroup2 -
Old domain vs. New keyword domain - Thoughts?
Okay. I'd like to get opinions as to what everyone thinks about domains lately. Here is any example: The current domain is general in nature, in fact, it's a persons name because they are a real estate agent. So the domain is something like JohnDoe.com. Current stats: Has approx. 130 linking domains pointing to it. Has over 300 incoming links from these linking domains. The link profile is clean and not spammy (not to say there are not a few that might be here and there) Was bough in 1994 The new domain would have very little value except it would be keyword rich such as PortlandHomesForSale.com (just an example). What are your thoughts. Thank you.
Technical SEO | | JordanRussell0 -
I have a ton of "duplicated content", "duplicated titles" in my website, solutions?
hi and thanks in advance, I have a Jomsocial site with 1000 users it is highly customized and as a result of the customization we did some of the pages have 5 or more different types of URLS pointing to the same page. Google has indexed 16.000 links already and the cowling report show a lot of duplicated content. this links are important for some of the functionality and are dynamically created and will continue growing, my developers offered my to create rules in robots file so a big part of this links don't get indexed but Google webmaster tools post says the following: "Google no longer recommends blocking crawler access to duplicate content on your website, whether with a robots.txt file or other methods. If search engines can't crawl pages with duplicate content, they can't automatically detect that these URLs point to the same content and will therefore effectively have to treat them as separate, unique pages. A better solution is to allow search engines to crawl these URLs, but mark them as duplicates by using the rel="canonical" link element, the URL parameter handling tool, or 301 redirects. In cases where duplicate content leads to us crawling too much of your website, you can also adjust the crawl rate setting in Webmaster Tools." here is an example of the links: | | http://anxietysocialnet.com/profile/edit-profile/salocharly http://anxietysocialnet.com/salocharly/profile http://anxietysocialnet.com/profile/preferences/salocharly http://anxietysocialnet.com/profile/salocharly http://anxietysocialnet.com/profile/privacy/salocharly http://anxietysocialnet.com/profile/edit-details/salocharly http://anxietysocialnet.com/profile/change-profile-picture/salocharly | | so the question is, is this really that bad?? what are my options? it is really a good solution to set rules in robots so big chunks of the site don't get indexed? is there any other way i can resolve this? Thanks again! Salo
Technical SEO | | Salocharly0