Why is there duplicates of my domain
-
When viewing crawl diagnostics in SEOmoz I can see both "www.website.com" and a truncated version "website.com" is this normal and why is it showing (I do not have duplicates of my site on the server)?
E.g.:
-
Hi All,
I have just altered my Google Webmaster tools in the Config (as per Geoff's advice above) and that appears to be fine for now. However, I have also updated my ".htaccess" file dong a 301 redirect, details below:
Options +FollowSymLinks
RewriteEngine onRewriteCond %{HTTP_HOST} !^www. [NC]
RewriteRule ^ http://www.%{HTTP_HOST}%{REQUEST_URI} [L,R=301]I also have recently changed my pages from .html to .php do I redirect by using this code as I want all old links to now refer to the .php file:
RewriteRule (.*).html$ /$1.php [R=301,L]
Lastly, Thomas on the canonical side of things, is it necessary for me to implement this in the Head?
How can I see if the work completed is correct or check that it works?
Paul.
-
Ok, I have implemented the Google Webmaster redirect. and now I have tried the edit to the .htaccess file trying both options below with no success.
Option 1:
AddHandler php-stable .php
RewriteEngine On
RewriteCond %{HTTP_HOST} !^www.RewriteRule ^(.*)$ http://www.%{HTTP_HOST}/$1 [R=301,L]Option 2:
AddHandler php-stable .php
Options +FollowSymLinks
RewriteEngine on
RewriteRule (.*) http://www.klinehimalaya.com/$1 [R=301,L]Neither seem to be working when viewed here:
http://anythinghere.klinehimalaya.com/Please help.
Thanks
-
Hey Mat,
Another question. If I have changed a page address from:
http://www.klinehimalaya.com/packages.html to
http://www.klinehimalaya.com/packages.phpwill I also need to redirect the pages I have changed from .html to .php or is this not needed because I have not changed the file name prior to the prefix?
Thanks.
Paul.
-
You can set the preferred domain just like Geoff mentioned. But basically since you have a www version and a non www version it can be seen as duplicate content. Although the site is only one website and changes will appear on each the URL structure changes for depending on if you use the www or non www and therefore it looks like duplicate content.
-
I have checked out your website we you may not have implemented the 301 redirect correctly. In addition you should use Google Webmaster tools along with
rel="canonical"
http://www.seomoz.org/blog/how-to-advanced-relcanonical-http-headers
http://support.google.com/webmasters/bin/answer.py?hl=en&answer=139394
Add a
rel="canonical"
link to the section of the non-canonical version of each HTML page.To specify a canonical link to the page http://www.example.com/product.php?item=swedish-fish, create a element as follows:
Copy this link into the section of all non-canonical versions of the page, such as http://www.example.com/product.php?item=swedish-fish&sort=price.
If you publish content on both http://www.example.com/product.php?item=swedish-fish and https://www.example.com/product.php?item=swedish-fish, you can specify the canonical version of the page. Create the element:
Add this link to the section of https://www.example.com/product.php?item=swedish-fish.
-
Hi,
If I was you I would go into Google Webmaster tools and verify both versions of the site, then go to Configuration >> Setting >> Preferred domain and tell Google your preference.
You will need to do this with both verified versions of the domain. You can then delete the listing for the one you do not want
You will only need one Google Verification code.
That will sort the issue with Google
Geoff
-
You have fixed the redirect loop, but the initial problem still exists. With the urgent issue now fixed (I can see the site now!) let's look at the problem:
You don't actually have a live problem at the moment, so any fix here will not improve your results. However you have a potential problem - one that could occur and cause you problems later. It's not hard to fix, so it is good to get it done.
Your server (like many) is set up to serve the same files to both klinehimalaya.com and www.klinehimalaya.com, which are technically different addresses. If google followed a link to klinehimalaya.com and a link to www.klinehimalaya.com if would find the content at two seperate places and could index both and consider them to be duplicate. Yes... all those PHDs and Google is still that stupid.
What you need to do (and I think you were trying to do this) is to pick one version of that address as the one that you are going to use. You can then redirect traffic from the other version to the chosen version.
In fact anythinghere.klinehimalaya.com is also serving up the same site, so you should fix the lot in one go.
If you are running apache (most sites are) then you can do this with an .htaccess redirect . There is a good example of how to do this at the top of this page: http://dense13.com/blog/2008/02/27/redirecting-non-www-to-www-with-htaccess/
In short it checks to see whether the address being loaded starts with www. . If it doesn't then it loads that version via a 301 redirect.
The issue Ross has pointed out is separate and not fixed by this. You should do both.
I hope that helps.
-
You are linking to your home page via your logo in the header.
However you are linking to this address http://www.klinehimalaya.com/index.php try linking to this address http://www.klinehimalaya.com/
This will remove your duplicate content issue.
-
Think I just fixed the redirect, but I still have an issue in SEOmoz where it is still pulling up both references to:
http://www.klinehimalaya.com/index.php
klinehimalaya.com/index.phpApparently this will effect my SEO efforts, hot to fix!!!
Thanks all!
-
I tried to look at this for you, but you have some issues on your site that are stopping me viewing it completely.
Both klinehimalaya.com and www.klinehimalaya.com create an infinite loop that prevents the page loading. klinehimalaya.com is correctly 301ing to www.klinehimalaya.com
However www.klinehimalaya.com is redirecting to itself.
You need to fix that URGENTLY. Start by looking at your htaccess file.
-
You need to do a 301 redirect
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate Content and Subdirectories
Hi there and thank you in advance for your help! I'm seeking guidance on how to structure a resources directory (white papers, webinars, etc.) while avoiding duplicate content penalties. If you go to /resources on our site, there is filter function. If you filter for webinars, the URL becomes /resources/?type=webinar We didn't want that dynamic URL to be the primary URL for webinars, so we created a new page with the URL /resources/webinar that lists all of our webinars and includes a featured webinar up top. However, the same webinar titles now appear on the /resources page and the /resources/webinar page. Will that cause duplicate content issues? P.S. Not sure if it matters, but we also changed the URLs for the individual resource pages to include the resource type. For example, one of our webinar URLs is /resources/webinar/forecasting-your-revenue Thank you!
Technical SEO | | SAIM_Marketing0 -
Tricky Duplicate Content Issue
Hi MOZ community, I'm hoping you guys can help me with this. Recently our site switched our landing pages to include a 180 item and 60 item version of each category page. They are creating duplicate content problems with the two examples below showing up as the two duplicates of the original page. http://www.uncommongoods.com/fun/wine-dine/beer-gifts?view=all&n=180&p=1 http://www.uncommongoods.com/fun/wine-dine/beer-gifts?view=all&n=60&p=1 The original page is http://www.uncommongoods.com/fun/wine-dine/beer-gifts I was just going to do a rel=canonical for these two 180 item and 60 item pages to the original landing page but then I remembered that some of these landing pages have page 1, page 2, page 3 ect. I told our tech department to use rel=next and rel=prev for those pages. Is there anything else I need to be aware of when I apply the canonical tag for the two duplicate versions if they also have page 2 and page 3 with rel=next and rel=prev? Thanks
Technical SEO | | znotes0 -
Domain change recommendations
We recently migrated one of our websites to a new domain. Obviously we were expecting a decrease in traffic initially, but it has actually gone down by 70% week-over-week since we made the switch. We set up a 301 redirect from the old domain to the new domain, changed all internal links to the new domain and changed all inbound links that we owned to the new domain. Our research suggested the best way to approach a domain change was by keeping it simple and not making too many changes at once. So my questions are: 1. Are these the kinds of results we should expect initially after a domain change? And if not, 2. What are the steps we should take from here? Thanks!
Technical SEO | | gouldtr0 -
Domain forwarding
Hi Is it ok or bad practice to domain forward shorter more memorable snappier domains used for promoting a website to a longer domain where the website actually lives, such as: Promoting in social media profiles, emails and offline literature a domain with forwarding set up like: www.brand.com To the main website: www.brandincludingprimaryproductrelatedkeyword.com And if ok (not bad practice), since its the forwarded domains that are being promoted they are hence the links most likely to be shared on social media and other websites so will they be treated like 301's and 'link building' for those will pretty much equate to link building for the main domain (or not) ? Many Thanks Dan
Technical SEO | | Dan-Lawrence0 -
Avoiding duplication in TLDs
I have started a ecom site with following config global version geekwik.com priced in usd india version geekwik.in priced in inr mostly the content in both sites is same (90% same), major difference is currency (and payment gateway) and helpline numbers etc How do I setup robots.txt and google webmaster so that indian users get results from India TLD and global users get results from global TLD and there is no duplication of content. .
Technical SEO | | geekwik0 -
Should we 301 redirect our old domain to the new domain
We have a product that when started was under the domain appnowgo.com. We've since changed the name and the domain is now knackhq.com. The latter domain doesn't rank nearly as well as the former for many of the keywords we are targeting. For example... "online database builder" and "web app builder" are two of those keywords. Obviously having app in the domain is not a bad thing but it is our old name. The question is, should we 301 the appnowgo.com domain to knackhq.com? Or should we use that better rank and just link users to knackhq.com from the appnowgo.com site until we can increase our ranking for knackhq.com? We don't plan to update the content on appnowgo.com anymore and we obviously don't want to drop off rank if at all possible. Thanks! Eric
Technical SEO | | sitestrux0 -
Subfolder to Root Domain, Should i or not?
Dear All, I am kinda of stuck and need your helps, I have major client's site which is located in subdirectory. Instance: http://www.majorclient.com.cn/cn/ and as you can see domain name is already localized and they are not planning to make any english version of the site, So there will be no /eng/ folder but clients whole website is /cn/ subdirectory which is totally unnecessary and i would like to 301 whole site to **http://www.majorclient.com.cn ** But the problem is that this site has been /cn/ folder forever since the beginning and lot of trusted links are pointing to www.majorclient.com.cn/cn/ So should i move it or just configure 301 www.majorclient.com.cn to www.majorclient.com.cn/cn/ leave it there and don't bother. Help?
Technical SEO | | DigitalJungle0 -
Multiple Domains, Same IP address, redirecting to preferred domain (301) -site is still indexed under wrong domains
Due to acquisitions over time and the merging of many microsites into one major site, we currently have 20+ TLD's pointing to the same IP address as our "preferred domain:" for our consolidated website http://goo.gl/gH33w. They are all set up as 301 redirects on apache - including both the www and non www versions. When we launched this consolidated website, (April 2010) we accidentally left the settings of our site open to accept any of our domains on the same IP. This was later fixed but unfortunately Google indexed our site under multiple of these URL's (ignoring the redirects) using the same content from our main website but swapping out the domain. We added some additional redirects on apache to redirect these individual pages pages indexed under the wrong domain to the same page under our main domain http://goo.gl/gH33w. This seemed to help resolve the issue and moved hundreds of pages off the index. However, in December of 2010 we made significant changes in our external dns for our ip addresses and now since December, we see pages indexed under these redirecting domains on the rise again. If you do a search query of : site:laboratoryid.com you will see a few hundred examples of pages indexed under the wrong domain. When you click on the link, it does redirect to the same page but under the preferred domain. So the redirect is working and has been confirmed as 301. But for some reason Google continues to crawl our site and index under this incorrect domains. Why is this? Is there a setting we are missing? These domain level and page level redirects should be decreasing the pages being indexed under the wrong domain but it appears it is doing the reverse. All of these old domains currently point to our production IP address where are preferred domain is also pointing. Could this be the issue? None of the pages indexed today are from the old version of these sites. They only seem to be the new content from the new site but not under the preferred domain. Any insight would be much appreciated because we have tried many things without success to get this resolved.
Technical SEO | | sboelter0