Question about duplicate listings on site for product listings.
-
We list products on our site and suspect that we have been hit by Panda as we are duplicating listings across our own site. Not intentionally, we just have multiple pages listings the same content as they fall into multiple categories.
Has anyone else had the same issue and if so how did you deal with it?.. Have you seen a change in results/rankings due to the changes you made?
-
Hello Nick,
It sounds like you're talking about category pages that link to product pages. I do recommend putting unique content on category pages, as they target different phases of a buying cycle (and keywords). For example...
"Blue Widgets" is a top-level category search.
"Blue Widgets for Men" is a category search."Men's V9 Blue Widget" (not the singular use of widget) is most likely a product search.
All three pages types should have their own unique content using keywords specific to that stage of the buying cycle, and displaying content that is useful to that stage of the buying cycle. For example...
"Blue Widgets" ---> Explain how to choose a blue widget. Which sub-category should they check out? Help them decide where to go next. Help them narrow their search.
"Men's Blue Widgets" ---> Explain the difference between brands and perhaps leading models. What are their needs and budget? Which are the high-end, top-of-the-line men's blue widgets, and which are affordable and reliable options, or entry-level widgets? Educate them.
"Men's V9 Blue Widget" ---> Explain the product. What are the features that either set it apart or make it a good value for the money?
The linking strategy can work this way as well. Naturally you're going to be passing pagerank from category pages into sub-categories and into products. This happens naturally on most sites because that is the natural flow of a purchasing path and a logical taxonomy. However you should also be passing pagerank back up if you want to help category pages rank. Enhanced produce descriptions give you an opportunity to do this.
Good luck!
-
Thanks for the detailed response Tom..
We have for example
A = Listings page with brief of all products
linking to B,C,D,E,F,G etc.. which are all specific pages for those products..
The B - G's rank ok for non competitive terms on the page but page's A dont rank so well.
The problem about no indexing A is that I think the other pages will get lost and have importance taken away from them..
Canonical from second pages of A listings yes, but what I was also thinking to do is put some unique content on page A in order to make that page more unique..Any thoughts on that?
-
Hi there
There are a few options here. Both revolve around making sure only version of your product listings is instructed to be indexed, so that you can promote that version via SEO.
The first solution would be to 301 redirect any duplications to one version of your product listings. This is the quickest and most absolute solution to duplicate listings, as it ensures only version of them remains live. However, depending on your CMS, this might not be possible.
The second solution would be to add robots instructions to the duplicate listings that instructs Google not to index those pages. You can do this by either adding code to the page itself or by using a robots.txt file. The code you'd need to add to the tag on the page is - however, if your CMS is producing duplicate URLs but only using one physical page, you may want to avoid this as it could block all versions of the page. In which case, you could add each duplicate URL to your robots.txt file, specifying you'd like to block them from being indexed, such as:
User Agent: *
Disallow: /example-page-1
Disallow: /example-page-2And so on. I like this robots.txt tutorial guide to learn more about how you can do this.
Finally, you could add canonical tags to each page to specify which version of the URL is the one you want to rank and be indexed, which should prevent others from being considered as well. For example, for a product listing page like: http://www.example.com/category-1/product-page-version-1 - if you want that page to be indexed, you will want to add a canonical tag in the of the code that reads:
Now, if that is the only physical web page that exists and your CMS generates additional, duplicate URLs with how it works, you will only need to add that canonical once. However, if other webpages actually exist in your CMS and server, you will need to add the same tag to the other duplicate pages. This basically tells Google and Bing: "Hey, this page is a duplicate, ignore this one and rank this one instead". Moz has a great guide on canonical usage here.
Dr. Pete also wrote a guide guide on canonical usage and how you can use it for products that are pretty much the same, but have slight differences such as sizes, colour etc.
I hope this helps answer your question - remember, the key here is to instruct Google that you don't want them to index the duplicates and that you don't have them to manipulate rankings. You're trying to have only one version indexed, and if others exist outside of redirects, you have instructed which version should be kept and which ones ignored.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Semi-duplicate content yet authoritative site
So I have 5 real estate sites. One of those sites is of course the original, and it has more/better content on most of the pages than the other sites. I used to be top ranked for all of the subdivsion names in my town. Then when I did the next 2-4 sites, I had some sites doing better than others for certain keywords, and then I have 3 of those sites that are basically the same URL structures (besides the actual domain) and they aren't getting fed very many visits. I have a couple of agents that work with me that I loaned my sites to to see if that would help since it would be a different name. My same youtube video is on each of the respective subdivision pages of my site and theirs. Also, their content is just rewritten content from mine about the same length of content. I have looked over and seen a few of my competitors who only have one site and their URL structures arent good at all, and their content isn't good at all and a good bit of their pages rank higher than my main site which is very frustrating to say the least since they are actually copy cats to my site. I sort of started the precedent of content, mapping the neighborhood, how far that subdivision is from certain landmarks, and then shot a video of each. They have pretty much done the same thing and are now ahead of me. What sort of advice could you give me? Right now, I have two sites that are almost duplicate in terms of a template and same subdivsions although I did change the content the best I could, and that site is still getting pretty good visits. I originally did it to try and dominate the first page of the SERPS and then Penguin and Panda came out and seemed to figure that game out. So now, I would still like to keep all the sites, but I'm assuming that would entail making them all unique, which seems to be tough seeing as though my town has the same subdivisions. Curious as to what the suggestions would be, as I have put a lot of time into these sites. If I post my site will it show up in the SERPS? Thanks in advance
Intermediate & Advanced SEO | | Veebs0 -
SEO question
Hi there! I'm the SEO manager for 5 Star Loans. I have 2 city pages running. We are running our business in 2 locations: Berkeley, CA & San Jose, CA. For those offices we've created 2 google listings with separate gmail accounts. Berkeley (http://5starloans.com/berkeley/) ranks well in Berkeley in Gmaps and it shows on first page in organic results. However the second city page San Jose (http://5starloans.com/san-jose/) doesn't show in the Gmaps local pack results and also doesn't rank well in organic results. Both of them have authentic backlinks and reviews. It has been a year already and it's high time we knew the problem 🙂 any comment would be helpful. thanks a lot
Intermediate & Advanced SEO | | moonalev0 -
SEO question regarding rails app on www.site.com hosted on Heroku and www.site.com/blog at another host
Hi, I have a rails app hosted on Heroku (www.site.com) and would much prefer to set up a Wordpress blog using a different host pointing to www.site.com/blog, as opposed to using a gem within the actual app. Whats are peoples thoughts regarding there being any ranking implications for implementing the set up as noted in this post on Stackoverflow: "What I would do is serve your Wordpress blog along side your Rails app (so you've got a PHP and a Rails server running), and just have your /blog route point to a controller that redirects to your Wordpress app. Add something like this to your routes.rb: _`get '/blog', to:'blog#redirect'`_ and then have a redirect method in your BlogController that simply does this: _`classBlogController<applicationcontrollerdef redirect="" redirect_to="" "url_of_wordpress_blog"endend<="" code=""></applicationcontrollerdef>`_ _Now you can point at yourdomain.com/blog and it will take you to the Wordpress site._
Intermediate & Advanced SEO | | Anward0 -
Is there a downside of an image coming from the site's dotted quad and can it be seen as a duplicate?
Ok the question doesn't fully explain the issue. I just want some opinions on this. Here is the backstory. I have a client with a domain that has been around for a while and was doing well but with no backlinks. (Fairly low competition). For some reason they created mirrors of their site on different urls. Then their web designer built them a test site that was a copy of their site on the web designer's url and didn't bother to noindex it. Client's site dived, the web designer's site started ranking for their keywords. So we helped clean that up, and they hired a brand new web designer and redesigned the site. For some reason the dotted quad version of the site started showing up as a referer in GA. So one image on the site comes from that and not the site's url. So I ran a copyscape and site search and discovered the dotted quad version like 69.64.153.116 (not the actual address) was also being indexed by the search engine. To us this seems like a cut and dry duplicate content issue, but I'm having trouble finding much written on the subject. I raised the issue with the dev, and he reluctantly 301 the site to the official url. The second part of this is the web designer still has that one image on the site coming from the numerical version of the site and not the written url. Any thoughts if that has any negative SEO impact? My thought it isn't ideal, but it just looks like an external referral for pulling that one image. I'd love any thoughts or experience on a situation like this.
Intermediate & Advanced SEO | | BCutrer0 -
Duplicate Content
http://www.pensacolarealestate.com/JAABA/jsp/HomeAdvice/answers.jsp?TopicId=Buy&SubtopicId=Affordability&Subtopicname=What%20You%20Can%20Afford http://www.pensacolarealestate.com/content/answers.html?Topic=Buy&Subtopic=Affordability I have no idea how the first address exists at all... I ran the SEOMOZ tool and I got 600'ish DUPLICATE CONTENT errors! I have errors on content/titles etc... How do I get rid of all the content being generated from this JAABA/JSP "jibberish"? Please ask questions that will help you help me. I have always been 1st on google local and I have a business that is starting to hurt very seriously from being number three 😞
Intermediate & Advanced SEO | | JML11790 -
Duplicate Content Question
My understanding of duplicate content is that if two pages are identical, Google selects one for it's results... I have a client that is literally sharing content real-time with a partner...the page content is identical for both sites, and if you update one page, teh otehr is updated automatically. Obviously this is a clear cut case for canonical link tags, but I'm cuious about something: Both sites seem to show up in search results but for different keywords...I would think one domain would simply win out over the other, but Google seems to show both sites in results. Any idea why? Also, could this duplicate content issue be hurting visibility for both sites? In other words, can I expect a boost in rankings with the canonical tags in place? Or will rankings remain the same?
Intermediate & Advanced SEO | | AmyLB0 -
Separate Site or should we incorporate it into our main site
Hello, We have a website to sell personal development trainings. The owners want to start 2 blogs - one for each owner - that promotes their personal coaching practices. What's the SEO advantages of embedding both blogs in the current site vs starting 2 brand new blogs with their names as the domain names?
Intermediate & Advanced SEO | | BobGW0 -
A very basic seo question
Sorry, been a long day and wanted a second opinion on this please.... I am developing an affiliate store which will have dozens of products in each category. We will not be indexing the product pages themselves as they are all duplicate content. The plan is to have just the first page of the category results indexed as this will have unique content about the products in that section. The later pagnated pages (ie pages 2,3,4,5 etc) will have 12 products on each but no unique content. Would the best advice be to add a canonical tag to all pages in the 'chairs' category pointing to the page with the first 12 results and the descriptions? This would ensure that the visitors are able to browse many pages of product but google won't index products 13 and onwards. Am I right in my thinkings? A supplemental question. What is the best way to block google from indexing/crawling 90,000 product listings which are pulled direct from the merchant so are not unique in the least. I have previous played with banning google from the product folder but it reports health issues in webmaster tools. Would the best route be a no index tag on all the product pages and to no follow all the products in the category listings? Many thanks Carl
Intermediate & Advanced SEO | | Grumpy_Carl0