Advice urgently needed on best practice for handling multiple product categories on Magento website
-
I have an ecommerce site built using Magento and urgently need advice on best practice for handling multiple product categories (where products appear in more than one category on the site creating multiple URLs to the same page).
In April this year, based on advice from my SEO who felt that duplicate content issues were causing my rankings to be held back, I changed about 25% of the product categories to 'noindex, follow'. This has made organic traffic fall (obviously) as these pages fell out of Google's index. But, contrary to what I was hoping for, it didn't then improve rankings - not one iota, nothing - which was the ONLY reason why I did this. This has had a real negative impact on sales, so I'm starting to think this was actually an a terrible idea.
Should I change them back?
And to ask a wider question, what is best practice for this particular scenario?
-
Hi,
If there already is a canonical link then you can edit it using the layout update code I first mentioned. If you do not need to canonical to another page you can just leave it as it is (self referencing).
As to if you want to do it or not, this really depends on how big of a problem it is for your search efforts and how many cats/products you will need to manually adjust. I would think that if you keep track of them in an excel and remember to check when you are updating that with a couple of hundred categories/products (of which only maybe a couple dozen or less might have to be manually edited?) then you should be able to manage it ok.
Good luck!
-
Thanks, I have regenerated the xml sitemap. Fingers crossed it doesn't take too long to see the pages fall back into the index!
As it happens, my developer has since emailed back to say that there is a canonical link for each category but it points to itself. Is that a problem?? He can't tell me.
Thinking about it, I'm unsure about manually adding a canonical link for each product/category. I'm concerned about errors creeping in over time, with URL changes, etc. With hundreds of products, I think it won't be too difficult for this to happen. Plus, the XML is automatically generated, so don't think the URLs will match. Have you had encountered these problems before?
-
HI,
For the canonicals if they are not being added automatically at the category level then you can still do it just removing the first part of the above that removes the old url, so like this:
<reference name="head"><action method="addLinkRel"><rel>canonical</rel>
<href>http://www.domain.com/canonicalUrl</href></action></reference>The above will add a canonical tag to whichever category page you add it to (in the layout update box).
The fetch as google does not reindex your site, it just previews how google sees the site. Make sure all the category pages are included in your sitemap and resubmit the sitemap to GWT. You can then see how many pages in the sitemap are indexed and that number should go up as google recrawls the site and finds the noindex tag removed.
-
Thanks for taking the trouble to answer. I have now made all categories 'index, follow'.
No canonicals are automatically added to category pages, so can't use this technique. Thanks for the suggestion, though.
Should I 'Fetch as Google' in WMT? If so, is it best to add the URL for every single category that I've updated? Or, just wait?
Appreciate your help, Lynn.
-
Hi,
I would do it all at once, nothing unusual about it and google may not see the change on all pages at the same time anyway.
For the rankings it is really impossible to say, you might get lucky, you might have to be patient, its not exactly like starting over again, especially if you have a couple of existing external links but....
For the canonical tags, there is a way to do it depending on your setup. Have you got canonicals being automatically added to the category pages as well as the product pages? If yes then you can overwrite them on a case by case basis by putting the following code in the 'custom layout update' box (this works for both products and categories actually).
<reference name="head"><action method="removeItem"><type>link_rel</type>
<name>http://www.domain.com/oldurl</name></action></reference><action method="addLinkRel"><rel>canonical</rel>
<href>http://www.domain.com/new-url</href></action>You will need to identify the canonical url being inputted into the code, add it to the oldurl bit above to remove it and then put in the new canonical url you want. Needless to say, it pays to be sure about what you are trying to achieve and why before implementing this setup on a lot of pages.
Hope it helps!
-
The website uses Magento version 1.4. which actually does have the canonical link back to the base URL feature. This was in place already before I started even messing around with making these changes.
I will revert the categories back to 'index, follow'. Some questions about this:
- Is it best to do it all at once (or will this look odd/'unnatural' somehow from Google's perspective)
- How long will it take for these pages to re-rank? They were made noindex in April, so would it be like starting again as if these were totally brand new pages?
Another SEO has recommended another approach, which is to identify the 'best' URL (from SEO point of view) and add the canonical link to the rest. Is there a way to implement/manage this easily in Magento? I can't seem to find a solution online on this.
-
That Yoast plugin is only developed up to Magento version 1.4 which is pretty old now. The good news is you can get some of this functionality out of the box now at Admin -> Configuration -> Catalog -> Search engine optimizations. If you set the use canonical meta tag link on products to yes then all product pages are given a canonical link back to a base url with no category in it. Baring a more advanced paid module or custom development, this is going to be your best bet.
Certainly change your category pages back to index, follow. Depending on your setup and how many common categories/products you have any duplicate content issue you have would usually be on a product more than a category level anyway. For category pages look at getting some good descriptions and other unique content on them. Check out this video for more details.
-
Change them all back to INDEX, FOLLOW and use Canonical plugin by yoast.
Canonical URL's for Magento • Yoast (sorry if links not allowed)
Some products on our site appear in six categories and we have no issues with duplicate content whatsoever using the above.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Advice on improving ecommerce product detail pages to rank better in google search results.
Hi all, I run an ecommerce website, not a great ranked site, however i want to try and improve the product detail pages. To do this, i am first going to focus on 1 page (this one: http://goo.gl/eS62SU) If i type the product code directly into google.co.uk search i am on the 8th page (see https://www.google.co.uk/#q=hac-hfw2220r-z&start=70) which is a bit poor to say the least. I see this kind of thing for a lot of my products. Hence, i am going to see if over the next month or two i can get this one page moving up the rankings purely with on page optimisation. I would like to ask a couple of things: 1. Is there anything that jumps out at you as to why that product detail page could NOT ever rank well, i.e some code / set up of page etc that prevents google ranking it 2. Any advice you could give that might improve that page in rankings for its product code. FYI - I can not change the dynamic URL, I only have control over such things as product name / summary / features / spec etc any advice welcome
Technical SEO | | isntworkdull0 -
How do I handle duplicate content of the same product in Multiple product categories?
I am building a BigCommerce store for selling framed art. Many of the pieces of art will fall in more than one product category. Let's say I have a framed print of a photograph of a western landscape. This piece of art would fit into these categories; "western", "landscape", and "photography". I would have three pages with duplicate content for just this one framed print. Will google give me less page rank due to this? Can all the link juice be given to just one of the three categories by use of rel=canonical? If so, does anyone know how to do this for a bigcommerce site? I would appreciate any feedback. Thanks, Kelly
Technical SEO | | Kelly_S0 -
Product Level 301 Redirects Best Practice
When creating a 301 mapping file for product pages, what is best practice
Technical SEO | | Bucktown
for which version of the URL to redirect to? Base directory or one
subdirectory/category path. Example Old URL: www.example.com/clothing/pants/blue-pants-123 Which of the following should be the new target URL: www.example.com/apparel/pants/blue-pants-123 www.example.com/apparel/blue-apparel/blue-pants-123 www.example.com/apparel/collections/spring-collection/blue-pants-123 www.example.com/blue-pants-123 This is assuming the canonical tag will be www.example.com/blue-pants-123. Also, if www.example.com/blue-pants-123 cannot be reached via site
navigation would it be detrimental to make that the target URL if Google
cannot crawl that naturally? Thanks0 -
What's the best URL Structure if my company is in multiple locations or cities?
I have read numerous intelligent, well informed responses to this question but have yet to hear a definitive answer from an authority. Here's the situation. Let's say I have a company who's URL is www.awesomecompany.com who provides one service called 'Awesome Service' This company has 20 franchises in the 20 largest US cities. They want a uniform online presence, meaning they want their design to remain consistent across all 20 domains. My question is this; what's the best domain or url structure for these 20 sites? Subdomain - dallas.awesomecompany.co Unique URL - www.dallasawesomecompany.com Directory - www.awesomecompany.com/dallas/ Here's my thoughts on this question but I'm really hoping someone b*tch slaps me and tells me I'm wrong: Of these three potential solutions these are how I would rank them and why: Subdomains Pros: Allows me to build an entire site so if my local site grows to 50+ pages, it's still easy to navigate Allows me to brand root domain and leverage brand trust of root domain (let's say the franchise is starbucks.com for instance) Cons: This subdomain is basically a brand new url in google's eyes and any link building will not benefit root domain. Directory Pros Fully leverages the root domain branding and fully allows for further branding If the domain is an authority site, ranking for sub pages will be achieved much quicker Cons While this is a great solution if you just want a simple map listing and contact info page for each of your 20 locations, what if each location want's their own "about us" page and their own "Awesome Service" page optimized for their respective City (i.e. Awesome Service in Dallas)? The Navigation and potentially the URL is going to start to get really confusing and cumbersome for the end user. Think about it, which is preferable?: dallas.awesomcompany.com/awesome-service/ www.awesomecompany.com/dallas/awesome-service (especially when www.awesomecompany.com/awesome-service/ already exists Unique URL Pros Potentially quicker rankings achieved than a subdomain if it's an exact match domain name (i.e. dallasawesomeservice.com) Cons Does not leverage the www.awesomecompany.com brand Could look like an imposter It is literally a brand new domain in Google's eyes so all SEO efforts would start from scratch Obviously what goes without saying is that all of these domains would need to have unique content on them to avoid duplicate content penalties. I'm very curious to hear what you all have to say.
Technical SEO | | BrianJGomez0 -
Best Practices for adding Dynamic URL's to XML Sitemap
Hi Guys, I'm working on an ecommerce website with all the product pages using dynamic URL's (we also have a few static pages but there is no issue with them). The products are updated on the site every couple of hours (because we sell out or the special offer expires) and as a result I keep seeing heaps of 404 errors in Google Webmaster tools and am trying to avoid this (if possible). I have already created an XML sitemap for the static pages and am now looking at incorporating the dynamic product pages but am not sure what is the best approach. The URL structure for the products are as follows: http://www.xyz.com/products/product1-is-really-cool
Technical SEO | | seekjobs
http://www.xyz.com/products/product2-is-even-cooler
http://www.xyz.com/products/product3-is-the-coolest Here are 2 approaches I was considering: 1. To just include the dynamic product URLS within the same sitemap as the static URLs using just the following http://www.xyz.com/products/ - This is so spiders have access to the folder the products are in and I don't have to create an automated sitemap for all product OR 2. Create a separate automated sitemap that updates when ever a product is updated and include the change frequency to be hourly - This is so spiders always have as close to be up to date sitemap when they crawl the sitemap I look forward to hearing your thoughts, opinions, suggestions and/or previous experiences with this. Thanks heaps, LW0 -
Advice on Linking to an Adult Related Website
I have a question regarding whether or not Google would penalize my main website for linking to a website that has adult content. The site I am linking to is not a porn site, rather it is a site that sells web site templates for adult related stores selling sexy toys, videos, etc. For example my site that is linking to the adult related website is here: http://www.websitetemplatedesign.com/ and the link to the site is in the footer at the bottom left which is an icon. And it links to http://www.adultsextemplates.com/ Im just looking for advice as to whether or not this could be a penalty or not. I did suffer major SERP loss in the last month and Im trying to find what I am doing that may have caused this. Any advice would be appreciated.
Technical SEO | | jmccommas0 -
Schema.org : reviewCount & ratingValue - best practices for implementation?
I'd like to add our merchant review count and rating to our site and use the schema.org markup to indicate to the search engines what these are. The reason I'd like to do this is so that the star rating pulls through to the organic listing. Check out this example from several UK tight sites. Notice how the organic listings display the star rating... My questions are: Has anyone seen an example of this from Google.com (US site) I heard that you should only add this markup to the homepape - but couldn't find any Google documentation to back this up. Do you know if this can be applied throughout the site w/o penalty? Thanks everyone!
Technical SEO | | evoNick0 -
What's the best format for a e-commerce URL product page
We have over 2000 non branded experiences and activities sold through our website. The website is having a face lift with the a new look and a stronger focus on SEO. As part of this, I am keen to establish what the best practice is for product based URLs. I've researched the market and come up with a few alternatives that are used: domain/category/subcategory/activity_name domain/activity_name/category/subcategory/activity_reference domain/generic_term/activity_reference/activity_name domain/category/activity_location/activity_name Activities are location based but the location can change (say once every 2 years). Activity names, category, subcategory and activity_reference rarely change. Are there any thoughts/ research on the best method? (If there is one) Many thanks in advance for your insights.
Technical SEO | | philwill0