My crawl diagnostic is showing 2 duplicate content and titles.
-
First of all Hi - My name is Jason and I've just joined - How you all doing?
My 1st question then:
When I view where these errors are occurring it says www mydomain co uk and www mydomain co uk/index.html
Isn't this the same page? I have looked into my root folder and only index.html exists.
-
Thanks Daniel!!!!
Looks like I'll be spending some time in the ol Q&A section
-
Hi Jason
That's perfect(and working) for redirecting all non www pages. You still need to decide on your original question regarding the index page!
Add the following to your htaccess file after the code you've already added :
RewriteCond %{THE_REQUEST} ^[A-Z]{3,9}\ /index\.html\ HTTP/ RewriteRule ^index\.html$ http://www.keystonemortgages.co.uk/ [R=301,L]
-
This is what I have added does it look OK?
Options +FollowSymLinks
RewriteEngine On
RewriteCond %{HTTP_HOST} ^keystonemortgages.co.uk
RewriteRule (.*) http://www.keystonemortgages.co.uk/$1 [R=301,L]
-
Thanks Alex I'll sit back and wait to see! fingers crossed it has a positive effect
-
It's not essential but still useful to have the canonical tag, it doesn't redirect but tells the crawlers the preferred address if you have more than one page/address containing the same content. It's particularly useful for duplicate content like print versions, or results pages based on query strings.
What you've actioned could improve the rankings to your homepage as before, the search engines will have seen the two addresses as separate pages, therefore competing against each other. When the redirect comes into effect the page authority and other metrics of both will be combined into one.
-
Hi quick update:
Just this mean I won't need a canonical tag in my header? Do they do similar things?
I've created the htaccess file and dropped it into my root folder at 1and1 so I guess now I sit back for a re crawl to see if it works?
One more thing. Is this likely to effect rankings?
-
Hey thanks Daniel cheers for the welcome
That sounds simple but I ain't got a clue how to do this so I'll start searching and let you know my results
Thanks for the lead,
Jason
-
Hi Jason and welcome to seoMoz!
If you do not have a rewrite in place(in your htaccess file) then both the www.mydomain.co.uk AND www.mydomain.co.uk/index.html will resolve in your browser. I suggest doing a 301 rewrite and while you're at it make sure you also rewrite all non www varients -> eg http://mydomain.co.uk 301 redirect that to http://www.mydomain.co.uk
You can then go set your preferred version in your Webmaster Tools.
This would be the code for apache(check with your host/developer if you're unsure) :
RewriteEngine On
RewriteCond %{HTTP_HOST} ^example.co.uk
RewriteRule (.*) http://www.example.co.uk/$1 [R=301,L]
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How are you using Moz Content?
Hey people, I just subscribed for Moz Content and I am wondering how are other professionals using it as a strategy tool. Today I just released a blog post talking about how larger content impacts PA. Not a big deal. I would appreciate some ideas and insights.
Moz Pro | | amirfariabr0 -
Duplicate Content
Hello, I'm managing a site which shows as having duplicate page issues (in the crawl analyser) for 3 pages. Basically the site is offering 3 different options of the same product so depending on which size you select, you are directed to the relevant page. These 3 pages are basically identical apart from a slight difference in copy regarding the size (small, medium, large) Is this likely to be a big issue regarding SEO, and what would the moz community suggest re this? Thank you!
Moz Pro | | wearehappymedia0 -
Update in Moz spider/tools?? Flagging duplicate content / ignoring canonical
Hi all, Has there been an update in the SEOmoz crawling software? We now have thousands of dupe content/page title warnings for paginated product page URLs that have correctly formatted canonicals. e.g. http://www.woolovers.com/british-wool/mens/tweed-green/wool-countryman-suede-patch-sweater.aspx ... has following pages with identical content that have been flagged: http://www.woolovers.com/british-wool/mens/olive-green/wool-countryman-suede-patch-sweater.aspx?p=true&rspage=4 http://www.woolovers.com/british-wool/mens/olive-green/wool-countryman-suede-patch-sweater.aspx?p=true&rspage=6 http://www.woolovers.com/british-wool/mens/olive-green/wool-countryman-suede-patch-sweater.aspx?p=true&rspage=4 ..plus 4 more URL's. But they all have canonical set. There's even a notice at the bottom of report that tells us there's a canonical set to http://www.woolovers.com/british-wool/mens/tweed-green/wool-countryman-suede-patch-sweater.aspx What gives, SEOmoz ?? Thanks Michael
Moz Pro | | LawrenceNeal0 -
What could be the reason that seomoz only shows crawl results for my homepage?
Hi there I am running three campaings for three different sites. The first site crawl is successful with a ful report. However the other two only shows results for the homepage, i.e. only a single page crawled by the mozbot. What could be the reason for this? Thanks, Gerrie
Moz Pro | | marketingmen0 -
Duplicate page errors
I have 102 duplicate page title errors and 64 duplicate page content errors. They are almost all from the email a friend forms that are on each product of my online store. I looked and the pages are identical except for the product name. Is this a real problem and if so is there a work around or should I see if I can turn off the email a friend option? Thanks for any information you can give me. Cingin Gifts
Moz Pro | | cingingifts0 -
Crawl Diagnostics Report Lacks Information
When I look at the crawl diagnostics, SEOMoz tells me there are 404 errors. This is understandable, because some pages were removed. What this report doesn't tell me is how those pages were discovered. This is a very important piece of information, because it would tell me there are links pointing to those pages, either internal or external. I believe the internal links have been removed. If the report told me how if found the link, I would be able to take immediate action. Without that information, I have to go so a lot of investigation. And when you have a million pages, that isn't easy. Some possibilities: The crawler remembered the page from the previous crawl. There was a link from an index page - i.e. it is in the database still There was an individual link from another story - so now there are broken links Ditto, but it in on a static index page The link was from an external source - I need to make a redirect Am I missing something, or is this a feature the SEO Moz crawler doesn't have yet? What can I do (other than check all my pages) to discover this?
Moz Pro | | loopyal0 -
Duplicate page title
I own a store www.mzube.co.uk and the scam always says that I have duplicate page titles or duplicate page. What happens is thn I may have for example www.mzube.co.uk/allproducts/page1. And if I hve 20 pages all what will change from each page is the number at the end and all the rest of the page name will be the same but really the pages are if different products. So the scans think I have 20 pages the same but I havent Is this a concern as I don't think I can avoid this Hope you can answer
Moz Pro | | mzube0 -
The Site Explorer crawl shows errors for files/folders that do not exist.
I'm fairly certain there is ultimately something amiss on our server but the Site Explorer report on my website (www.kpmginstitutes.com) is showing thousands of folders that do not exist. Example: For my "About Us" page (www.kpmginstitutes.com/about-us.aspx), the report shows a link: www.kpmginstitutes.com/rss/industries/404-institute/404-institute/about-us.aspx. We do have "rss", "industries", "404-institute" folders but they are parallel in the architecture, not sequential as indicated in the error url. Has anyone else seen these types of error in your Site Explorer reports?
Moz Pro | | dturkington0