Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Google keeps marking different pages as duplicates
-
My website has many pages like this:
mywebsite/company1/valuation
mywebsite/company2/valuation
mywebsite/company3/valuation
mywebsite/company4/valuation
...
These pages describe the valuation of each company.
These pages were never identical but initially, I included a few generic paragraphs like what is valuation, what is a valuation model, etc... in all the pages so some parts of these pages' content were identical.
Google marked many of these pages as duplicated (in Google Search Console) so I modified the content of these pages: I removed those generic paragraphs and added other information that is unique to each company. As a result, these pages are extremely different from each other now and have little similarities.
Although it has been more than 1 month since I made the modification, Google still marks the majority of these pages as duplicates, even though Google has already crawled their new modified version. I wonder whether there is anything else I can do in this situation?
Thanks
-
Google may mark different pages as duplicates if they contain very similar or identical content. This can happen due to issues such as duplicate metadata, URL parameters, or syndicated content. To address this, ensure each page has unique and valuable content, use canonical tags when appropriate, and manage URL parameters in Google Search Console.
-
Yes, there are a few other things you can do if Google is still marking your pages as duplicates after you have modified them to be unique:
-
Check your canonical tags. Canonical tags tell Google which version of a page is the preferred one to index. If you have canonical tags in place and they are pointing to the correct pages, then Google should eventually recognize that the duplicate pages are not actually duplicates.
-
Use the URL parameter tool in Google Search Console. This tool allows you to tell Google which URL parameters it should treat as unique and which ones it should ignore. This can be helpful if you have pages with similar content but different URL parameters, such as pages for different product categories or pages with different sorting options.
-
Request a recrawl of your website. You can do this in Google Search Console. Once Google has recrawled your website, it will be able to see the new, modified versions of your pages.
If you have done all of the above and Google is still marking your pages as duplicates, then you may need to contact Google Support for assistance.
-
-
If Google is marking different pages on your website as duplicates, it can negatively impact your website's search engine rankings. Here are some common reasons why Google may be doing this and steps you can take to address the issue:
Duplicate Content: Google's algorithms are designed to filter out duplicate content from search results. Ensure that your website does not have identical or near-identical content on multiple pages. Each page should offer unique and valuable content to users.
URL Parameters: If your website uses URL parameters for sorting, filtering, or tracking purposes, Google may interpret these variations as duplicate content. Use canonical tags or the URL parameter tool in Google Search Console to specify which version of the URL you want to be indexed.
Pagination: For websites with paginated content (e.g., product listings, blog archives), ensure that you implement rel="next" and rel="prev" tags to indicate the sequence of pages. This helps Google understand that the pages are part of a series and not duplicates.
www vs. non-www: Make sure you have a preferred domain (e.g., www.example.com or example.com) and set up 301 redirects to the preferred version. Google may treat www and non-www versions as separate pages with duplicate content.
HTTP vs. HTTPS: Ensure that your website uses secure HTTPS. Google may view HTTP and HTTPS versions of the same page as duplicates. Implement 301 redirects from HTTP to HTTPS to resolve this.
Mobile and Desktop Versions: If you have separate mobile and desktop versions of your site (e.g., responsive design or m.example.com), use rel="alternate" and rel="canonical" tags to specify the relationship between the two versions.
Thin or Low-Quality Content: Pages with little or low-quality content may be flagged as duplicates. Improve the content on such pages to provide unique value to users.
Canonical Tags: Implement canonical tags correctly to indicate the preferred version of a page when there are multiple versions with similar content.
XML Sitemap: Ensure that your XML sitemap is up-to-date and accurately reflects your website's structure. Submit it to Google Search Console.
Avoid Scraped Content: Ensure that your content is original and not scraped or copied from other websites. Google penalizes sites with duplicate or plagiarized content.
Check for Technical Errors: Use Google Search Console to check for crawl errors or other technical issues that might be causing duplicate content problems.
Structured Data: Ensure that your structured data (schema markup) is correctly implemented on your pages. Incorrectly structured data can confuse search engines.
Regularly monitor Google Search Console for any duplicate content issues and take prompt action to address them. It's essential to provide unique and valuable content to your website visitors while ensuring that search engines can correctly index and rank your pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Page Indexing without content
Hello. I have a problem of page indexing without content. I have website in 3 different languages and 2 of the pages are indexing just fine, but one language page (the most important one) is indexing without content. When searching using site: page comes up, but when searching unique keywords for which I should rank 100% nothing comes up. This page was indexing just fine and the problem arose couple of days ago after google update finished. Looking further, the problem is language related and every page in the given language that is newly indexed has this problem, while pages that were last crawled around one week ago are just fine. Has anyone ran into this type of problem?
Technical SEO | | AtuliSulava1 -
Best SEO Structure For E-Commerce With Products Using Multiple Categories
Hi all, I am in the process of re-structuring my e-commerce website for better SEO and user experience. I have done some keyword research and would like some advice on how best to structure my site around those keywords. For example, my site (All Things Nature) sells a brand of wooden sculptures (Woodsculp) and I would like to rank for keywords related to that brand, the brand by animal, the brand by collection and the brand by release date.
Content Development | | nb2e4fg
Examples of keywords could be: Brand by Animal: Woodsculp Dogs, Woodsculp Cats, Woodsculp Elephants
Brand by Collection: Woodsculp Pets, Woodsculp Safari
Brand by Release Date: Woodsculp Christmas 2023, Woodsculp Summer 2022 I would create each of these keywords as a category so that they can be found by a search engine and by users. I would then structure as follows: All Things Nature -> Woodsculp -> Woodsculp by Animal -> Woodsculp Dogs
All Things Nature -> Woodsculp -> Woodsculp by Animal -> Woodsculp Elephants
All Things Nature -> Woodsculp -> Woodsculp by Collection -> Woodsculp Pets
All Things Nature -> Woodsculp -> Woodsculp by Collection -> Woodsculp Safari
All Things Nature -> Woodsculp -> Woodsculp by Release Date -> Woodsculp Christmas 2023
All Things Nature -> Woodsculp -> Woodsculp by Release Date -> Woodsculp Summer 2022 The only problem with this structure is it would take more than 3 clicks (4) for the user to reach a product. How critical is this for good SEO and user experience? Would I be better off getting rid of the ‘Woodsculp by Animal’, ‘Woodsculp by Collection’ and ‘Woodsculp by Release Date’ categories? Structure would look as follows: All Things Nature -> Woodsculp -> Woodsculp Dogs
All Things Nature -> Woodsculp -> Woodsculp Elephants
All Things Nature -> Woodsculp -> Woodsculp Safari
All Things Nature -> Woodsculp -> Woodsculp Christmas 2023 The only thing with this is there would be a lot of categories under the brand name which might make it more difficult for search engines and users to logically follow. Would I be better off getting rid of the brand category and replace them with the keyword categories? Structure would look as follows: All Things Nature -> Woodsculp by Animal -> Woodsculp Dogs
All Things Nature -> Woodsculp by Animal -> Woodsculp Elephants
All Things Nature -> Woodsculp by Collection -> Woodsculp Safari
All Things Nature -> Woodsculp by Release Date -> Woodsculp Christmas 2023 This would organise things more logically but I would then lose the brand category (and the potential of the brand keyword ranking?) Would I be better off choosing one main keyword to use as a category and then use tags for the other categories? Categories: All Things Nature -> Woodsculp -> Woodsculp Dogs
All Things Nature -> Woodsculp -> Woodsculp Elephants Tags: Woodsculp Safari
Woodsculp Christmas 2023 The next issue I have is that I have products which could fall under several different categories. A product called Elijah Elephant, for example could fall under Woodsculp Elephants, Woodsculp Safari and Woodsculp Summer 2022. In previous e-commerce sites I have never assigned multiple categories to one product (I instead have used tags). Is it good practice to organise products under multiple categories for an e-commerce site? Thanks in advance for any help and advice.0 -
How to rank a website in different countries
I have a website which I want to rank in UK, NZ and AU and I want to keep my domain as .com in all the countries. I have specified the lang=en now what needs to be done to rank one website in 3 different English countries without changing the domain extension i.e. .com.au or .com.nz
SEO Tactics | | Ravi_Rana0 -
Duplicate content, although page has "noindex"
Hello, I had an issue with some pages being listed as duplicate content in my weekly Moz report. I've since discussed it with my web dev team and we decided to stop the pages from being crawled. The web dev team added this coding to the pages <meta name='robots' content='max-image-preview:large, noindex dofollow' />, but the Moz report is still reporting the pages as duplicate content. Note from the developer "So as far as I can see we've added robots to prevent the issue but maybe there is some subtle change that's needed here. You could check in Google Search Console to see how its seeing this content or you could ask Moz why they are still reporting this and see if we've missed something?" Any help much appreciated!
Technical SEO | | rj_dale0 -
Unsolved SEO And Digital Marketing Training
Hi Everyone, I have a basic SEO and Digital Marketing knowledge and looking for a course /training which will teach me step by step SEO and tools need to use with hand on training. I have a website (https://gemslearninginstitute.com/) which I need bring in Google Packs and on the first page of Google. I have attended a few courses but none of them offered in depth knowledge with hands on training so whatever I do it is not producing results. Thanks
SEO Tactics | | fslpso0 -
Collections or blog posts for Shopify ecommerce seo?
Hi, hope you guys can help as I am going down a rabbit hole with this one! We have a solid-ranking sports nutrition site and are building a new SEO keyword strategy on our Shopify built store. We are using collections (categories) for much of the key product-based seo. This is because, as we understand it, Google prioritises collection/category pages over product pages. Should we then build additional collection pages to rank for secondary product search terms that could fit a collection page structure (eg 'vegan sports nutrition'), or should we use blog posts to do this? We have a quality blog with good unique content and reasonable domain authority so both options are open to us. But while the collection/category option may be best for SEO, too many collections/categories could upset our UX. We have a very small product range (10 products) so want to keep navigation fast and easy. Our 7 lead keyword collection pages do this already. More run the risk of upsetting ease/speed of site navigation. On the other hand, conversion rate from collection pages is historically much better than blog pages. We have made major technical upgrades to the blog to improve this but these are yet to be tested in anger. So at the heart of it all - do you guys recommend favouring blog posts or collection/category pages for secondary high sales intent keywords? All help gratefully received - thanks!
SEO Tactics | | WP332 -
How to check if an individual page is indexed by Google?
So my understanding is that you can use site: [page url without http] to check if a page is indexed by Google, is this 100% reliable though? Just recently Ive worked on a few pages that have not shown up when Ive checked them using site: but they do show up when using info: and also show their cached versions, also the rest of the site and pages above it (the url I was checking was quite deep) are indexed just fine. What does this mean? thank you p.s I do not have WMT or GA access for these sites
Technical SEO | | linklander0 -
Duplicate Content Issues on Product Pages
Hi guys Just keen to gauge your opinion on a quandary that has been bugging me for a while now. I work on an ecommerce website that sells around 20,000 products. A lot of the product SKUs are exactly the same in terms of how they work and what they offer the customer. Often it is 1 variable that changes. For example, the product may be available in 200 different sizes and 2 colours (therefore 400 SKUs available to purchase). Theese SKUs have been uploaded to the website as individual entires so that the customer can purchase them, with the only difference between the listings likely to be key signifiers such as colour, size, price, part number etc. Moz has flagged these pages up as duplicate content. Now I have worked on websites long enough now to know that duplicate content is never good from an SEO perspective, but I am struggling to work out an effective way in which I can display such a large number of almost identical products without falling foul of the duplicate content issue. If you wouldnt mind sharing any ideas or approaches that have been taken by you guys that would be great!
Technical SEO | | DHS_SH0