undefined
Skip to content
Moz logo Menu open Menu close
  • Products
    • Moz Pro
    • Moz Pro Home
    • Moz Local
    • Moz Local Home
    • STAT
    • Moz API
    • Moz API Home
    • Compare SEO Products
    • Moz Data
  • Free SEO Tools
    • Domain Analysis
    • Keyword Explorer
    • Link Explorer
    • Competitive Research
    • MozBar
    • More Free SEO Tools
  • Learn SEO
    • Beginner's Guide to SEO
    • SEO Learning Center
    • Moz Academy
    • SEO Q&A
    • Webinars, Whitepapers, & Guides
  • Blog
  • Why Moz
    • Agency Solutions
    • Enterprise Solutions
    • Small Business Solutions
    • Case Studies
    • The Moz Story
    • New Releases
  • Log in
  • Log out
  • Products
    • Moz Pro

      Your all-in-one suite of SEO essentials.

    • Moz Local

      Raise your local SEO visibility with complete local SEO management.

    • STAT

      SERP tracking and analytics for enterprise SEO experts.

    • Moz API

      Power your SEO with our index of over 44 trillion links.

    • Compare SEO Products

      See which Moz SEO solution best meets your business needs.

    • Moz Data

      Power your SEO strategy & AI models with custom data solutions.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Free SEO Tools
    • Domain Analysis

      Get top competitive SEO metrics like DA, top pages and more.

    • Keyword Explorer

      Find traffic-driving keywords with our 1.25 billion+ keyword index.

    • Link Explorer

      Explore over 40 trillion links for powerful backlink data.

    • Competitive Research

      Uncover valuable insights on your organic search competitors.

    • MozBar

      See top SEO metrics for free as you browse the web.

    • More Free SEO Tools

      Explore all the free SEO tools Moz has to offer.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Learn SEO
    • Beginner's Guide to SEO

      The #1 most popular introduction to SEO, trusted by millions.

    • SEO Learning Center

      Broaden your knowledge with SEO resources for all skill levels.

    • On-Demand Webinars

      Learn modern SEO best practices from industry experts.

    • How-To Guides

      Step-by-step guides to search success from the authority on SEO.

    • Moz Academy

      Upskill and get certified with on-demand courses & certifications.

    • MozCon

      Save on Early Bird tickets and join us in London or New York City

    Unlock flexible pricing & new endpoints
    Moz API

    Unlock flexible pricing & new endpoints

    Find your plan
  • Blog
  • Why Moz
    • Small Business Solutions

      Uncover insights to make smarter marketing decisions in less time.

    • Agency Solutions

      Earn & keep valuable clients with unparalleled data & insights.

    • Enterprise Solutions

      Gain a competitive edge in the ever-changing world of search.

    • The Moz Story

      Moz was the first & remains the most trusted SEO company.

    • Case Studies

      Explore how Moz drives ROI with a proven track record of success.

    • New Releases

      Get the scoop on the latest and greatest from Moz.

    Surface actionable competitive intel
    New Feature

    Surface actionable competitive intel

    Learn More
  • Log in
    • Moz Pro
    • Moz Local
    • Moz Local Dashboard
    • Moz API
    • Moz API Dashboard
    • Moz Academy
  • Avatar
    • Moz Home
    • Notifications
    • Account & Billing
    • Manage Users
    • Community Profile
    • My Q&A
    • My Videos
    • Log Out

The Moz Q&A Forum

  • Forum
  • Questions
  • Users
  • Ask the Community

Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

  1. Home
  2. Digital Marketing
  3. Web Design
  4. Duplicate Content for index.html

Moz Q&A is closed.

After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

Duplicate Content for index.html

Web Design
5
9
4.9k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as question
Log in to reply
This topic has been deleted. Only users with question management privileges can see it.
  • superTallDan
    superTallDan last edited by May 29, 2011, 6:01 PM

    In the Crawl Diagnostics Summary, it says that I have two pages with duplicate content which are:

    www.mywebsite.com/

    www.mywebsite.com/index.html

    I read in a Dream Weaver tutorial that you should name your home page "index.html" and then you can let www.mywebsite.com automatically direct the user to index.html.  Is this a bug in SEOMoz's crawler or is it a real problem with my site?

    Thank you,

    Dan

    1 Reply Last reply Reply Quote 0
    • SEMCLIX
      SEMCLIX @superTallDan last edited by Jul 1, 2011, 7:41 PM Jul 1, 2011, 7:41 PM

      The code should definitely go into the websites root directory's .htaccess, however .htaccess can be weird, a few days ago I ran into a similar issue with a client's website, and I was able to remedy the issue with a variation of the code.

      index Redirect RewriteCond %{THE_REQUEST} ^[A-Z]{3,9}\ /([^/]+/)index.(php|html|htm|asp)\ HTTP/ RewriteRule ^(([^/]+/))index.(php|html|htm|asp)$ http://yoursite.com/$1 [R=301,L]

      If you give me the URL for the site I will take a look at it and let you know what would be feasible.

      1 Reply Last reply Reply Quote 0
      • KeriMorgret
        KeriMorgret @superTallDan last edited by Jun 30, 2011, 8:47 PM Jun 30, 2011, 8:47 PM

        Hi Daniel, can you share with us the URL of your site? We can take a look at it and give you a more precise answer that way. Thanks!

        1 Reply Last reply Reply Quote 0
        • superTallDan
          superTallDan @SEMCLIX last edited by Jun 30, 2011, 4:28 PM Jun 30, 2011, 4:28 PM

          I eventually figured out that your method was a 301 redirect and I definitely broke my site trying to use the code you posted. .. haha.  Its ok though.  I just removed the code and it went back to normal.  At first, I was editing the .htaccess file in the public_html folder which wasnt working.  Then I tried the root folder for the site (I created the .htaccess file since it did not exist.)  Neither of those worked.  (I am using Bluehost so I do not think that I have root access and I am not sure if it is a Linux server or not.)

          If there is an easy way to explain what I am doing wrong, please do so.  Otherwise, I will use canonical.

          Thanks for everything!

          KeriMorgret SEMCLIX 2 Replies Last reply Jul 1, 2011, 7:41 PM Reply Quote 0
          • SEMCLIX
            SEMCLIX last edited by Jun 28, 2011, 12:43 AM Jun 28, 2011, 12:43 AM

            @Dan

            Thanks for your reply.  It seems like there are lots of different ways to solve this problem.  I just watched this video on Matt Cutt's blog where he discusses his preference for 301 redirects over rel canonical tag.

            Where would you say your solution fits in?

            sorry about the delay of this response, i didn't realize the that you were asking me a question right away. When placing the code I provided in my previous answer this will cause a 301 perminant redirect to the original URL. That's actually what the

            [R=301,L]

            portion of the code is stating (R) redirect (301) status is referring to. After reviewing the Matt Cutts video, I realize that I should have asked you if you were operating on a Linux server  that you had root access to. We actually utilize both redirects and canonical tags since it was recommended by the on-page optimization reports. Heck Google uses them, I would assume because it's easier for the user to be referred to a single page URL. Obviously though if you don't have server header access, and are not familiar with .htaccess (you can accidentally break your site) then the canonical solution is appropriate

            superTallDan 1 Reply Last reply Jun 30, 2011, 4:28 PM Reply Quote 0
            • topic:timeago_earlier,28 days
            • superTallDan
              superTallDan @SEMCLIX last edited by May 31, 2011, 8:59 AM May 31, 2011, 8:59 AM

              Josh,

              Thanks for your reply.  It seems like there are lots of different ways to solve this problem.  I just watched this video on Matt Cutt's blog where he discusses his preference for 301 redirects over rel canonical tag.

              Where would you say your solution fits in?

              Thanks,
              Dan

              watch?v=zW5UL3lzBOA

              1 Reply Last reply Reply Quote 0
              • usaccess608
                usaccess608 last edited by May 29, 2011, 7:57 PM May 29, 2011, 7:57 PM

                use the link rel tag for all my homepages for the http://www.yoursite.com

                1 Reply Last reply Reply Quote 0
                • SEMCLIX
                  SEMCLIX last edited by Jun 25, 2011, 11:36 AM May 29, 2011, 6:48 PM

                  Odd enough I just recently answered this question. The SEOmoz crawler is correct, because without a redirect you will be able to access both versions of the page in your browser.

                  www.yoursite.com/

                  www.yoursite.com/index.html

                  To resolve this issue simply rewrite the index.html to the root url by placing the following code into your .htaccess file into your root directory.

                  Options +FollowSymlinks                                                                                                            RewriteEngine on

                  Index Rewrite                                                                                                                                RewriteRule ^index.(htm|html|php) http://www.yoursite.com/ [R=301,L]                                      RewriteRule ^(.*)/index.(htm|html|php) http://www.yoursite.com/$1/ [R=301,L]

                  You can also do the same with the index file in any subdirectories that you might create, by simply placing a .htaccess into those sub directories and using variations of the above code. This is how you create nice tight URLs without the duplicate content issue that look like - http://www.semclix.com/design/business/

                  superTallDan 1 Reply Last reply May 31, 2011, 8:59 AM Reply Quote 2
                  • RyanKent
                    RyanKent last edited by May 29, 2011, 6:32 PM May 29, 2011, 6:32 PM

                    It is a problem which you need to fix. You need to canonicalize your pages.

                    www.mywebsite.com

                    www.mywebsite.com/

                    www.mywebsite.com/index.html

                    mywebsite.com/

                    mywebsite.com/index.html

                    Those are all various URLs which most likely lead to the same web page. I say "most likely" because these URLs can actually lead to different pages.

                    You need to tell crawlers and search engines how you organize your site. There are several ways to achieve canonicalization. The method I prefer is to add the following line of code to each page:

                    The URL provided should be the preferred URL for your page.

                    1 Reply Last reply Reply Quote 0
                    • 1 / 1
                    1 out of 9
                    • First post
                      1/9
                      Last post

                    Got a burning SEO question?

                    Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


                    Start my free trial


                    Browse Questions

                    Explore more categories

                    • Moz Tools

                      Chat with the community about the Moz tools.

                    • SEO Tactics

                      Discuss the SEO process with fellow marketers

                    • Community

                      Discuss industry events, jobs, and news!

                    • Digital Marketing

                      Chat about tactics outside of SEO

                    • Research & Trends

                      Dive into research and trends in the search industry.

                    • Support

                      Connect on product support and feature requests.

                    • See all categories

                    Related Questions

                    • calvinkj

                      Does changing content and design of the website gonna affect my all the backlinks i have made till now

                      i have been working on my link profile for a month now, after learning about 5 step moz methodology i have decided that i would like to change all of the content of my site and taylor it to what my customers need, am i gonna loose all the domain authority if make changes? if it gonna affect, hows that  gonna come out

                      Web Design | Dec 12, 2023, 4:17 PM | calvinkj
                      0
                    • jcobo

                      Making html table as 'seofriendly' as possible

                      Hi, On my website I have a table with a list of products, on every row I have a different product and a different property on each column. The table is made with css so the html code is clean. The problem is (I guess) that google doesn't 'understand' what its inside on the table. So if I do a google search that page appears on the page 87, there is any way to improve my SEO without changing the table? Or to improve my SEO I must change the format of my content? In resume, I want to improve the SEO page of a page that contains information organized inside a table. I don't know if there is a specific answer to this question. Any help is welcome. Regards

                      Web Design | Apr 23, 2018, 3:42 AM | jcobo
                      0
                    • CalicoKitty2000

                      Migration from HTML to Wordpress - SEO Implications?

                      I am in the process of having a wordpress site developed to replace my current HTML site. (I currently have my website in html and a blog in wordpress in a sub directory).  I am doing this in phases to try and preserve as much of my good rankings as possible.  My first phase is to replicate my site with the exact same pages, meta data, and site structure.  I'm hoping that google will see this as not much change and not change my rankings for the worse.  I also made it a goal that my site speed tests be at least equal to what they are now. We will have to 301 all of the URLs however since it will be going from /example.html to /example.  I believe my blog will also need to move into the root directory as well, so I need to 301 all of those pages. I plan to wait a couple months for Phase 2.  Phase 2 involves replacing old content (photo galleries), and introducing new content (virtual tours, videos, new pages, etc.) One of my reasons for moving to wordpress is to keep up with current trends a little easier since I have very little time.  (I am owner, website maintainer, SEO - all on my own). My question here is three parts.  1. Do you think this strategy will work to preserve my current rankings? 2. Do you have any lessons learned or advice to share with me to make this as smooth as possible? 3. Do I really need to wait to add new content?  I might get antsy and want to do it sooner!  🙂 Thank you in advance!

                      Web Design | Sep 27, 2022, 8:29 AM | CalicoKitty2000
                      1
                    • SEOguy1

                      Problems preventing Wordpress attachment pages from being indexed and from being seen as duplicate content.

                      Hi According to a Moz Crawl, it looks like the Wordpress attachment pages from all image uploads are being indexed and seen as duplicate content..or..is it the Yoast sitemap causing it? I see 2 options in SEO Yoast: Redirect attachment URLs to parent post URL. Media...Meta Robots: noindex, follow I set it to (1) initially which didn't resolve the problem.  Then I set it to option (2) so that all images won't be indexed but search engines would still associate those images with their relevant posts and pages. However, I understand what both of these options (1) and (2) mean, but because I chose option 2, will that mean all of the images on the website won't stand a chance of being indexed in search engines and Google Images etc? As far as duplicate content goes, search engines can get confused and there are 2 ways for search engines
                      to reach the correct page content destination. But when eg Google makes the wrong choice a portion of traffic drops off (is lost hence errors) which then leaves the searcher frustrated, and this affects the seo and ranking of the site which worsens with time. My goal here is - I would like all of the web images to be indexed by Google, and for all of the image attachment pages to not be indexed at all (Moz shows the image attachment pages as duplicates and the referring site causing this is the sitemap url which Yoast creates) ; that sitemap url has been submitted to the search engines already and I will resubmit once I can resolve the attachment pages issues.. Please can you advise. Thanks.

                      Web Design | Feb 25, 2016, 8:51 AM | SEOguy1
                      0
                    • KempRugeLawGroup

                      Fixing Render Blocking Javascript and CSS in the Above-the-fold content

                      We don't have a responsive design site yet, and our mobile site is built through Dudamobile. I know it's not the best, but I'm trying to do whatever we can until we get around to redesigning it. Is there anything I can do about the following Page Speed Insight errors or are they just a function of using Dudamobile? Eliminate render-blocking JavaScript and CSS in above-the-fold content Your page has 3 blocking script resources and 5 blocking CSS resources. This causes a delay in rendering your page.None of the above-the-fold content on your page could be rendered without waiting for the following resources to load. Try to defer or asynchronously load blocking resources, or inline the critical portions of those resources directly in the HTML.Remove render-blocking JavaScript: http://ajax.googleapis.com/ajax/libs/jquery/2.1.1/jquery.min.js http://mobile.dudamobile.com/…ckage.min.js?version=2015-04-02T13:36:04 http://mobile.dudamobile.com/…pts/blogs.js?version=2015-04-02T13:36:04 Optimize CSS Delivery of the following: http://fonts.googleapis.com/…:400|Great+Vibes|Signika:400,300,600,700 http://mobile.dudamobile.com/…ont-pack.css?version=2015-04-02T13:36:04 http://mobile.dudamobile.com/…kage.min.css?version=2015-04-02T13:36:04 http://irp-cdn.multiscreensite.com/kempruge/files/kempruge_0.min.css?v=6 http://irp-cdn.multiscreensite.com/…mpruge/files/kempruge_home_0.min.css?v=6 Thanks for any tips, Ruben

                      Web Design | Jun 16, 2017, 3:50 PM | KempRugeLawGroup
                      0
                    • InvoqMarketing

                      Duplicate content on websites for multiple countries

                      I have a client who has a website for their U.S. based customers. They are currently adding a Canadian dealer and would like a second website with much of the same info as their current website, but with Canadian contact info etc. What is the best way to do this without creating duplicate content that will get us penalized? If we create a website at ABCcompany.com and ABCCompany.ca or something like that, will that get us around the duplicate content penalty?

                      Web Design | Apr 9, 2014, 8:01 AM | InvoqMarketing
                      0
                    • danatanseo

                      Can anyone recommend a tool that will identify unused and duplicate CSS across an entire site?

                      Hi all, So far I have found this one: http://unused-css.com/   It looks like it identifies unused, but perhaps not duplicates? It also has a 5,000 page limit and our site is 8,000+ pages....so we really need something that can handle a site larger than their limit. I do have Screaming Frog. Is there a way to use Screaming Frog to locate unused and duplicate CSS? Any recommendations and/or tips would be great. I am also aware of the Firefix extensions, but to my knowledge they will only do one page at a time? Thanks!

                      Web Design | Mar 4, 2014, 4:19 PM | danatanseo
                      0
                    • NoahsDad

                      Facebook code being duplicated? (Any developers mind taking a peek?)

                      I'm using a few different plug ins to give me various Facebook functions on my site. I'm curious there are any developers out there would could take a look at my source code and see if it looks there is some code being duplicated that's slowing down my site. Thanks so much!

                      Web Design | Jul 5, 2012, 1:48 AM | NoahsDad
                      0

                    Get started with Moz Pro!

                    Unlock the power of advanced SEO tools and data-driven insights.

                    Start my free trial
                    Products
                    • Moz Pro
                    • Moz Local
                    • Moz API
                    • Moz Data
                    • STAT
                    • Product Updates
                    Moz Solutions
                    • SMB Solutions
                    • Agency Solutions
                    • Enterprise Solutions
                    Free SEO Tools
                    • Domain Authority Checker
                    • Link Explorer
                    • Keyword Explorer
                    • Competitive Research
                    • Brand Authority Checker
                    • Local Citation Checker
                    • MozBar Extension
                    • MozCast
                    Resources
                    • Blog
                    • SEO Learning Center
                    • Help Hub
                    • Beginner's Guide to SEO
                    • How-to Guides
                    • Moz Academy
                    • API Docs
                    About Moz
                    • About
                    • Team
                    • Careers
                    • Contact
                    Why Moz
                    • Case Studies
                    • Testimonials
                    Get Involved
                    • Become an Affiliate
                    • MozCon
                    • Webinars
                    • Practical Marketer Series
                    • MozPod
                    Connect with us

                    Contact the Help team

                    Join our newsletter
                    Moz logo
                    © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                    • Accessibility
                    • Terms of Use
                    • Privacy

                    Looks like your connection to Moz was lost, please wait while we try to reconnect.