undefined
Skip to content
Moz logo Menu open Menu close
  • Products
    • Moz Pro
    • Moz Pro Home
    • Moz Local
    • Moz Local Home
    • STAT
    • Moz API
    • Moz API Home
    • Compare SEO Products
    • Moz Data
  • Free SEO Tools
    • Domain Analysis
    • Keyword Explorer
    • Link Explorer
    • Competitive Research
    • MozBar
    • More Free SEO Tools
  • Learn SEO
    • Beginner's Guide to SEO
    • SEO Learning Center
    • Moz Academy
    • MozCon
    • Webinars, Whitepapers, & Guides
  • Blog
  • Why Moz
    • Digital Marketers
    • Agency Solutions
    • Enterprise Solutions
    • Small Business Solutions
    • The Moz Story
    • New Releases
  • Log in
  • Log out
  • Products
    • Moz Pro

      Your all-in-one suite of SEO essentials.

    • Moz Local

      Raise your local SEO visibility with complete local SEO management.

    • STAT

      SERP tracking and analytics for enterprise SEO experts.

    • Moz API

      Power your SEO with our index of over 44 trillion links.

    • Compare SEO Products

      See which Moz SEO solution best meets your business needs.

    • Moz Data

      Power your SEO strategy & AI models with custom data solutions.

    Track AI Overviews in Keyword Research
    Moz Pro

    Track AI Overviews in Keyword Research

    Try it free!
  • Free SEO Tools
    • Domain Analysis

      Get top competitive SEO metrics like DA, top pages and more.

    • Keyword Explorer

      Find traffic-driving keywords with our 1.25 billion+ keyword index.

    • Link Explorer

      Explore over 40 trillion links for powerful backlink data.

    • Competitive Research

      Uncover valuable insights on your organic search competitors.

    • MozBar

      See top SEO metrics for free as you browse the web.

    • More Free SEO Tools

      Explore all the free SEO tools Moz has to offer.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Learn SEO
    • Beginner's Guide to SEO

      The #1 most popular introduction to SEO, trusted by millions.

    • SEO Learning Center

      Broaden your knowledge with SEO resources for all skill levels.

    • On-Demand Webinars

      Learn modern SEO best practices from industry experts.

    • How-To Guides

      Step-by-step guides to search success from the authority on SEO.

    • Moz Academy

      Upskill and get certified with on-demand courses & certifications.

    • MozCon

      Save on Early Bird tickets and join us in London or New York City

    Unlock flexible pricing & new endpoints
    Moz API

    Unlock flexible pricing & new endpoints

    Find your plan
  • Blog
  • Why Moz
    • Digital Marketers

      Simplify SEO tasks to save time and grow your traffic.

    • Small Business Solutions

      Uncover insights to make smarter marketing decisions in less time.

    • Agency Solutions

      Earn & keep valuable clients with unparalleled data & insights.

    • Enterprise Solutions

      Gain a competitive edge in the ever-changing world of search.

    • The Moz Story

      Moz was the first & remains the most trusted SEO company.

    • New Releases

      Get the scoop on the latest and greatest from Moz.

    Surface actionable competitive intel
    New Feature

    Surface actionable competitive intel

    Learn More
  • Log in
    • Moz Pro
    • Moz Local
    • Moz Local Dashboard
    • Moz API
    • Moz API Dashboard
    • Moz Academy
  • Avatar
    • Moz Home
    • Notifications
    • Account & Billing
    • Manage Users
    • Community Profile
    • My Q&A
    • My Videos
    • Log Out

The Moz Q&A Forum

  • Forum
  • Questions
  • Users
  • Ask the Community

Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

  1. Home
  2. SEO Tactics
  3. Technical SEO
  4. Duplicate Content and URL Capitalization

Moz Q&A is closed.

After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

Duplicate Content and URL Capitalization

Technical SEO
3
9
7.4k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as question
Log in to reply
This topic has been deleted. Only users with question management privileges can see it.
  • Jom
    Jom last edited by Jul 6, 2012, 11:20 AM

    I have multiple URLs that SEOMoz is reporting as duplicate content.  The reason is that there are characters in the URL that may, or may not, be capitalized depending on user input.

    A couple examples are:

    www.househitz.com/Pennsylvania/Houses-for-sale

    www.househitz.com/Pennsylvania/houses-for-sale

    www.househitz.com/Pennsylvania/Houses-for-rent

    www.househitz.com/Pennsylvania/houses-for-rent

    There are currently thousands of instances of this on the site.

    Is this something I should spend effort to try and resolve (may not be minor effort), or should I just ignore it and move on?

    1 Reply Last reply Reply Quote 0
    • Marcus_Miller
      Marcus_Miller @Jom last edited by Jul 9, 2012, 6:01 AM Jul 9, 2012, 6:01 AM

      Hey Jom, you only rewrite the URL if it is not all lowercase, you can distinguish between lower and upper-case in your rewrites.

      1 Reply Last reply Reply Quote 0
      • Jom
        Jom @MarkLoud last edited by Jul 6, 2012, 3:02 PM Jul 6, 2012, 3:02 PM

        Mark,

        In the canonicalization guide link you sent me, there is a link to Matt Cutts' blog www.mattcutts.com/blog/seo-advice-url-canonicalization/ where he talks about it.  In that blog he posts:

        Q: So when you say www vs. non-www, you’re talking about a type of canonicalization. Are there other ways that urls get canonicalized?
        A: Yes, there can be a lot, but most people never notice (or need to notice) them. Search engines can do things like keeping or removing trailing slashes, trying to convert urls with upper case to lower case, or removing session IDs from bulletin board or other software (many bulletin board software packages will work fine if you omit the session ID).

        This makes me think that doing a 301 redirect and a rel="canonical" for lower case is not needed.

        I'm conflicted again.

        1 Reply Last reply Reply Quote 0
        • Jom
          Jom @Jom last edited by Jul 6, 2012, 2:14 PM Jul 6, 2012, 2:14 PM

          When you rewrite a URL that is already lower case  to lower case with a 301 response code, does it now return a 301?  Does that mean all pages on the site now return 301? Wouldn't that be bad?

          Sorry if I'm being dense.  I understand enough about rewrite rules to be dangerous (sometimes, very dangerous).

          Jom

          1 Reply Last reply Reply Quote 0
          • Marcus_Miller
            Marcus_Miller @Jom last edited by Jul 6, 2012, 12:09 PM Jul 6, 2012, 12:09 PM

            Yeah, it is absolutely the right thing to do. You can force the URLs t be lower case in RoR as well if you don't want to do it in htaccess (i would do both).

            You are simply saying:

            • there are multiple versions of this page on different urls

            • this is the main version of the page

            301 them to lower case and canonicalise them and you are good to go!

            Marcus

            1 Reply Last reply Reply Quote 0
            • Jom
              Jom @MarkLoud last edited by Jul 6, 2012, 11:57 AM Jul 6, 2012, 11:57 AM

              Thanks, much!  I will read through these.

              1 Reply Last reply Reply Quote 0
              • Jom
                Jom @Marcus_Miller last edited by Jul 6, 2012, 11:56 AM Jul 6, 2012, 11:56 AM

                Hi Marcus and Mark,

                Thanks for the response.  On creating the rel="canonical" statements.

                That means that I will have thousands, perhaps hundreds of thousands (there are a lot of cities and zips in the US) of rel="canonical" statements on my site.

                I thought I read on one of the blogs that too many canonical statements are bad practice.  The site is dynamic (Ruby on Rails), I can certainly make the change.  I would just like to be sure it's the wise thing to do.

                Marcus_Miller Jom 3 Replies Last reply Jul 9, 2012, 6:01 AM Reply Quote 0
                • MarkLoud
                  MarkLoud last edited by Jul 6, 2012, 11:39 AM Jul 6, 2012, 11:39 AM

                  Hey Jom,

                  I must admit I am not sure on the level of urgency to sort this problem out but personally I like to keep the duplication of content to a minimum.

                  There are multiple ways to sort this out but the most straight forward would probably be to add a rel canonical tag to your web pages.

                  Here is a good post discussing the faceted issues you can get from e-commerce site, here is SEOMoz's canonicalization guide and here is another seomoz blog post about e-commerce sites and the use of the rel canonical tag.

                  Hope this helps

                  Jom 2 Replies Last reply Jul 6, 2012, 3:02 PM Reply Quote 0
                  • Marcus_Miller
                    Marcus_Miller last edited by Jul 6, 2012, 11:34 AM Jul 6, 2012, 11:34 AM

                    Hey Jom

                    Problem is, from a search engine perspective, those are four duplicate pages & from a linking perspective, they are four different pages that you could see your link popularity shared between. Neither of which is ideal.

                    I would certainly deal with this but it needn't be an arduous task.

                    1. Set up a rewrite rule to change all URLs to lowercase and 301 any non lowercase ones, something like this in your htaccess should do the job assuming you are using a LAMP environment.

                    RewriteEngine On
                    RewriteMap  lc int:tolower
                    RewriteCond %{REQUEST_URI} [A-Z]
                    RewriteRule (.*) ${lc:$1} [R=301,L]
                    

                    2. Add an automated lowercase canonical to all of these pages so they canonicalise to the lowercase version.

                    3. Try to replace the links so they all use lowercase. If this is a dynamic site it should be easy but if not, you could still do a string replacement across multiple files. You could write a little script to automate this if it is a huge job from the sitemap (of lowercase URLs of course.


                    Certainly worth doing and should not be too difficult with a bit of smarts applied. 🙂

                    Hope this helps!
                    Marcus

                    Jom 1 Reply Last reply Jul 6, 2012, 11:56 AM Reply Quote 2
                    • 1 / 1
                    1 out of 9
                    • First post
                      1/9
                      Last post

                    Got a burning SEO question?

                    Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


                    Start my free trial


                    Browse Questions

                    Explore more categories

                    • Moz Tools

                      Chat with the community about the Moz tools.

                    • SEO Tactics

                      Discuss the SEO process with fellow marketers

                    • Community

                      Discuss industry events, jobs, and news!

                    • Digital Marketing

                      Chat about tactics outside of SEO

                    • Research & Trends

                      Dive into research and trends in the search industry.

                    • Support

                      Connect on product support and feature requests.

                    • See all categories

                    Related Questions

                    • SAIM_Marketing

                      Duplicate Content and Subdirectories

                      duplicate content subdirectory directories

                      Hi there and thank you in advance for your help! I'm seeking guidance on how to structure a resources directory (white papers, webinars, etc.) while avoiding duplicate content penalties. If you go to /resources on our site, there is filter function. If you filter for webinars, the URL becomes /resources/?type=webinar We didn't want that dynamic URL to be the primary URL for webinars, so we created a new page with the URL /resources/webinar that lists all of our webinars and includes a featured webinar up top. However, the same webinar titles now appear on the /resources page and the /resources/webinar page. Will that cause duplicate content issues? P.S. Not sure if it matters, but we also changed the URLs for the individual resource pages to include the resource type. For example, one of our webinar URLs is /resources/webinar/forecasting-your-revenue Thank you!

                      Technical SEO | Apr 1, 2024, 6:55 PM | SAIM_Marketing
                      0
                    • znotes

                      Duplicate Content Issues with Pagination

                      Hi Moz Community, We're an eCommerce site so we have a lot of pagination issues but we were able to fix them using the rel=next and rel=prev tags. However, our pages have an option to view 60 items or 180 items at a time. This is now causing duplicate content problems when for example page 2 of the 180 item view is the same as page 4 of the 60 item view. (URL examples below) Wondering if we should just add a canonical tag going to the the main view all page to every page in the paginated series to get ride of this issue. https://www.example.com/gifts/for-the-couple?view=all&n=180&p=2 https://www.example.com/gifts/for-the-couple?view=all&n=60&p=4 Thoughts, ideas or suggestions are welcome. Thanks

                      Technical SEO | Jul 10, 2017, 12:31 PM | znotes
                      0
                    • Digital-DMG

                      How to deal with duplicated content on product pages?

                      Hi, I have a webshop with products with different sizes and colours. For each item I have a different URL, with almost the same content (title tag, product descriptions, etc). In order to prevent duplicated content I'am wondering what is the best way to solve this problem, keeping in mind: -Impossible to create one page/URL for each product with filters on colour and size -Impossible to rewrite the product descriptions in order to be unique I'm considering the option to canonicolize the rest of de colours/size variations, but the disadvantage is that in case the product is not in stock it disappears from the website. Looking forward to your opinions and solutions. Jeroen

                      Technical SEO | Mar 16, 2015, 11:43 AM | Digital-DMG
                      0
                    • fabrizzio

                      Localized domains and duplicate content

                      Hey guys, In my company we are launching a new website and there's an issue it's been bothering me for a while. I'm sure you guys can help me out. I already have a website, let's say ABC.com I'm preparing a localized version of that website for the uk so we'll launch ABC.co.uk Basically the websites are going to be exactly the same with the difference of the homepage. They have a slightly different proposition. Using GeoIP I will redirect the UK traffic to ABC.co.uk and the rest of the traffic will still visit .com website. May google penalize this? The site itself it will be almost the same but the homepage. This may count as duplicate content even if I'm geo-targeting different regions so they will never overlap. Thanks in advance for you advice

                      Technical SEO | Feb 16, 2013, 4:42 PM | fabrizzio
                      0
                    • GeorgFranz

                      How to prevent duplicate content at a calendar page

                      Hi, I've a calender page which changes every day. The main url is
                      /calendar For every day, there is another url: /calendar/2012/09/12
                      /calendar/2012/09/13
                      /calendar/2012/09/14 So, if the 13th september arrives, the content of the page 
                      /calendar/2012/09/13
                      will be shown at
                      /calendar So, it's duplicate content. What to do in this situation? a) Redirect from /calendar to /calendar/2012/09/13 with 301? (but the redirect changes the day after to  /calendar/2012/09/14) b) Redirect from /calendar to /calendar/2012/09/13 with 302 (but I will loose the link juice of /calendar?) c) Add a canonical tag at /calendar (which leads to /calendar/2012/09/13) - but I will loose the power of /calendar (?) - and it will change every day... Any ideas or other suggestions? Best wishes, Georg.

                      Technical SEO | Sep 10, 2012, 2:21 PM | GeorgFranz
                      0
                    • ericmccarty

                      How much to change to avoid duplicate content?

                      Working on a site for a dentist.  They have a long list of services that they want us to flesh out with text.  They provided a bullet list of services, we're trying to get 1 to 2 paragraphs of text for each. Obviously, we're not going to write this off the top of our heads.  We're pulling text from other sources and trying to rework. The question is, how much rephrasing do we have to do to avoid a duplicate content penalty?  Do we make sure there are changes per paragraph, sentence, or phrase? Thanks! Eric

                      Technical SEO | Mar 20, 2012, 4:58 PM | ericmccarty
                      0
                    • ChristianMKTG

                      Drupal URL Aliases vs 301 Redirects + Do URL Aliases create duplicates?

                      Hi all! I have just begun work on a Drupal site which heavily uses the URL Aliases feature. I fear that it is creating duplicate links. For example:: we have http://www.URL.com/index.php and http://www.URL.com/ In addition we are about to switch a lot of links and want to keep the search engine benefit. Am I right in thinking URL aliases change the URL, while leaving the old URL live and without creating search engine friendly redirects such as 301s? Thanks for any help! Christian

                      Technical SEO | Nov 11, 2011, 5:29 AM | ChristianMKTG
                      0
                    • jackson_lo

                      CGI Parameters: should we worry about duplicate content?

                      Hi, My question is directed to CGI Parameters. I was able to dig up a bit of content on this but I want to make sure I understand the concept of CGI parameters and how they can affect indexing pages. Here are two pages: No CGI parameter appended to end of the URL: http://www.nytimes.com/2011/04/13/world/asia/13japan.html CGI parameter appended to the end of the URL: http://www.nytimes.com/2011/04/13/world/asia/13japan.html?pagewanted=2&ref=homepage&src=mv Questions: Can we safely say that CGI parameters = URL parameters that append to the end of a URL? Or are they different? And given that you have rel canonical implemented correctly on your pages, search engines will move ahead and index only the URL that is specified in that tag? Thanks in advance for giving your insights. Look forward to your response. Best regards, Jackson

                      Technical SEO | Apr 14, 2011, 6:35 PM | jackson_lo
                      0

                    Get started with Moz Pro!

                    Unlock the power of advanced SEO tools and data-driven insights.

                    Start my free trial
                    Products
                    • Moz Pro
                    • Moz Local
                    • Moz API
                    • Moz Data
                    • STAT
                    • Product Updates
                    Moz Solutions
                    • SMB Solutions
                    • Agency Solutions
                    • Enterprise Solutions
                    • Digital Marketers
                    Free SEO Tools
                    • Domain Authority Checker
                    • Link Explorer
                    • Keyword Explorer
                    • Competitive Research
                    • Brand Authority Checker
                    • Local Citation Checker
                    • MozBar Extension
                    • MozCast
                    Resources
                    • Blog
                    • SEO Learning Center
                    • Help Hub
                    • Beginner's Guide to SEO
                    • How-to Guides
                    • Moz Academy
                    • API Docs
                    About Moz
                    • About
                    • Team
                    • Careers
                    • Contact
                    Why Moz
                    • Case Studies
                    • Testimonials
                    Get Involved
                    • Become an Affiliate
                    • MozCon
                    • Webinars
                    • Practical Marketer Series
                    • MozPod
                    Connect with us

                    Contact the Help team

                    Join our newsletter
                    Moz logo
                    © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                    • Accessibility
                    • Terms of Use
                    • Privacy

                    Looks like your connection to Moz was lost, please wait while we try to reconnect.