Advice urgently needed on best practice for handling multiple product categories on Magento website
-
I have an ecommerce site built using Magento and urgently need advice on best practice for handling multiple product categories (where products appear in more than one category on the site creating multiple URLs to the same page).
In April this year, based on advice from my SEO who felt that duplicate content issues were causing my rankings to be held back, I changed about 25% of the product categories to 'noindex, follow'. This has made organic traffic fall (obviously) as these pages fell out of Google's index. But, contrary to what I was hoping for, it didn't then improve rankings - not one iota, nothing - which was the ONLY reason why I did this. This has had a real negative impact on sales, so I'm starting to think this was actually an a terrible idea.
Should I change them back?
And to ask a wider question, what is best practice for this particular scenario?
-
Hi,
If there already is a canonical link then you can edit it using the layout update code I first mentioned. If you do not need to canonical to another page you can just leave it as it is (self referencing).
As to if you want to do it or not, this really depends on how big of a problem it is for your search efforts and how many cats/products you will need to manually adjust. I would think that if you keep track of them in an excel and remember to check when you are updating that with a couple of hundred categories/products (of which only maybe a couple dozen or less might have to be manually edited?) then you should be able to manage it ok.
Good luck!
-
Thanks, I have regenerated the xml sitemap. Fingers crossed it doesn't take too long to see the pages fall back into the index!
As it happens, my developer has since emailed back to say that there is a canonical link for each category but it points to itself. Is that a problem?? He can't tell me.
Thinking about it, I'm unsure about manually adding a canonical link for each product/category. I'm concerned about errors creeping in over time, with URL changes, etc. With hundreds of products, I think it won't be too difficult for this to happen. Plus, the XML is automatically generated, so don't think the URLs will match. Have you had encountered these problems before?
-
HI,
For the canonicals if they are not being added automatically at the category level then you can still do it just removing the first part of the above that removes the old url, so like this:
<reference name="head"><action method="addLinkRel"><rel>canonical</rel>
<href>http://www.domain.com/canonicalUrl</href></action></reference>The above will add a canonical tag to whichever category page you add it to (in the layout update box).
The fetch as google does not reindex your site, it just previews how google sees the site. Make sure all the category pages are included in your sitemap and resubmit the sitemap to GWT. You can then see how many pages in the sitemap are indexed and that number should go up as google recrawls the site and finds the noindex tag removed.
-
Thanks for taking the trouble to answer. I have now made all categories 'index, follow'.
No canonicals are automatically added to category pages, so can't use this technique. Thanks for the suggestion, though.
Should I 'Fetch as Google' in WMT? If so, is it best to add the URL for every single category that I've updated? Or, just wait?
Appreciate your help, Lynn.
-
Hi,
I would do it all at once, nothing unusual about it and google may not see the change on all pages at the same time anyway.
For the rankings it is really impossible to say, you might get lucky, you might have to be patient, its not exactly like starting over again, especially if you have a couple of existing external links but....
For the canonical tags, there is a way to do it depending on your setup. Have you got canonicals being automatically added to the category pages as well as the product pages? If yes then you can overwrite them on a case by case basis by putting the following code in the 'custom layout update' box (this works for both products and categories actually).
<reference name="head"><action method="removeItem"><type>link_rel</type>
<name>http://www.domain.com/oldurl</name></action></reference><action method="addLinkRel"><rel>canonical</rel>
<href>http://www.domain.com/new-url</href></action>You will need to identify the canonical url being inputted into the code, add it to the oldurl bit above to remove it and then put in the new canonical url you want. Needless to say, it pays to be sure about what you are trying to achieve and why before implementing this setup on a lot of pages.
Hope it helps!
-
The website uses Magento version 1.4. which actually does have the canonical link back to the base URL feature. This was in place already before I started even messing around with making these changes.
I will revert the categories back to 'index, follow'. Some questions about this:
- Is it best to do it all at once (or will this look odd/'unnatural' somehow from Google's perspective)
- How long will it take for these pages to re-rank? They were made noindex in April, so would it be like starting again as if these were totally brand new pages?
Another SEO has recommended another approach, which is to identify the 'best' URL (from SEO point of view) and add the canonical link to the rest. Is there a way to implement/manage this easily in Magento? I can't seem to find a solution online on this.
-
That Yoast plugin is only developed up to Magento version 1.4 which is pretty old now. The good news is you can get some of this functionality out of the box now at Admin -> Configuration -> Catalog -> Search engine optimizations. If you set the use canonical meta tag link on products to yes then all product pages are given a canonical link back to a base url with no category in it. Baring a more advanced paid module or custom development, this is going to be your best bet.
Certainly change your category pages back to index, follow. Depending on your setup and how many common categories/products you have any duplicate content issue you have would usually be on a product more than a category level anyway. For category pages look at getting some good descriptions and other unique content on them. Check out this video for more details.
-
Change them all back to INDEX, FOLLOW and use Canonical plugin by yoast.
Canonical URL's for Magento • Yoast (sorry if links not allowed)
Some products on our site appear in six categories and we have no issues with duplicate content whatsoever using the above.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Root domain change - how do we best handle existing backlinks from our own content platforms on youtube, etc?
Hi, we have recently changed our brand name after 7 years and have changed our root domain to match (33shake.com since 2012, now 33 fuel.com) The site is the same (no migration to a new one) as there were no other business changes apart from the name/domain. 301 redirects are looking after all former 33shake.com links, which are now being redirected to their new 33fuel.com equivalents (slugs are the same in 99% of cases). My question is: We have a lot of backlinks for our old domain (33shake.com) on our own content via our YouTube channel (100+ videos) and also our podcast (64 episodes in, broadcast on 10 platforms). For maximum SEO benefit as we continue to restore domain authority, etc to 33fuel.com, are we best to leave these historical backlinks pointed at the old domain and let the redirects pick them up when people click? Or are we better off swapping all of these old historical backlinks so they point directly to the new domain? Any advice would be greatly appreciated, this is quite a maze we are now picking our way through! Warren
Technical SEO | | WP331 -
Best way to handle 301 redirects on a business directory
We work with quite a few sites that promote retail traders and feature a traders' directory with pages for each of the shops (around 500 listings in most cases). As retail strips, shops come and go all the time, so I get a lot of pages that are removed as the business is no longer present. Currently I've been doing 301 redirects to the home page of the directory if you try to access a deleted trader page, but this means a ever growing htaccess file with thousands of 301 redirects. Are we handling this the best way or is there a better way to tackle this situation?
Technical SEO | | Assemblo0 -
Website Alerts
Hi
Technical SEO | | Bossandy
Does anyone know of plugins/ extensions for joomla or wordpress to alert us as soon as a site goes down?0 -
Google not indexing my website
Hi guys, We have this website http://www.m-health-expo.nl/ but it is not indexed by google. In webmaster tools google says that it can not fetch the site due to the robots.txt but i do not see any faults in it. http://www.m-health-expo.nl/robots.txt Do you see something strange, it really bothers me.
Technical SEO | | RuudHeijnen0 -
Industry News Page Best Practices
Hi, We have created an industry news page which automatically curates articles from specific news sources within our sector. Currently, I have the news index page set to be indexed and followed by robots. I have the article pages noindex, nofollow, since these are not original content. Is this the best practice or do you recommend another configuration? Thanks!
Technical SEO | | JoshGFialkoff0 -
Best Practices for adding Dynamic URL's to XML Sitemap
Hi Guys, I'm working on an ecommerce website with all the product pages using dynamic URL's (we also have a few static pages but there is no issue with them). The products are updated on the site every couple of hours (because we sell out or the special offer expires) and as a result I keep seeing heaps of 404 errors in Google Webmaster tools and am trying to avoid this (if possible). I have already created an XML sitemap for the static pages and am now looking at incorporating the dynamic product pages but am not sure what is the best approach. The URL structure for the products are as follows: http://www.xyz.com/products/product1-is-really-cool
Technical SEO | | seekjobs
http://www.xyz.com/products/product2-is-even-cooler
http://www.xyz.com/products/product3-is-the-coolest Here are 2 approaches I was considering: 1. To just include the dynamic product URLS within the same sitemap as the static URLs using just the following http://www.xyz.com/products/ - This is so spiders have access to the folder the products are in and I don't have to create an automated sitemap for all product OR 2. Create a separate automated sitemap that updates when ever a product is updated and include the change frequency to be hourly - This is so spiders always have as close to be up to date sitemap when they crawl the sitemap I look forward to hearing your thoughts, opinions, suggestions and/or previous experiences with this. Thanks heaps, LW0 -
Need Help with MAGENTO - URL rewrite
Hello... Hopefully a Magento expert will stumble across this question and help me out. I have noticed that my site is no longer as prominent as it once was for specific product pages... I am looking for help in rewriting the URL's for the product pages. I want it to have xyz.com/product (which exists if you hard code it into the site) If you wind up on the product by clicking throught the categories the url looks like: xyz.com/category/subcategory/product. Does anyone know how to make it so when you land on a product page it is just xyz.com/product ? My Site is : http://goo.gl/JgK1e Thanks for the help...
Technical SEO | | Prime850 -
Well, I need some help, advice, something.
Hey all, I'm new to the SEOmoz thing but I like it so far. I think I have my site listing so messed up that it's effecting my rank. I have 3 domains. 1.) rt112media.com 2.) route112media.com 3.) route112.net. Each domain was purchased through GoDaddy.com and still remain there. I have my own hosting account which I was registered as rt112media.com with route112media.com and route112.net listed as add on domains. Technically, I would like for my main site to be route112media.com for everything. However when I registered the site as rt112media.com I didn't know the issues I would have as far as different domains so I registered with rt112media.com as my main domain name. Anyways, as of now I have rt112media.com as my main domain through my cpanel hosting.I have both domains route112media.com and route112.net set for 301 wildcard redirects to rt112media.com on my hosting account and my GoDaddy account. When I started my WMT account I didn't really know which domain to use cause I figured I could link them all to one. So, I signed up as routet12media.com. After a little while I realized it was not recieving anything because everything was being redirected to rt112media.com Anyways both addresses have been crawled and indexed so they are showing as two. So, I requested to change the route112media.com address to rt112media.com in WMT. That was about 2 weeks ago and it is still pending request. I'm not having further problems with WMT because of the www.rt112media.com vs http://rt112media.com. I am the verified owner of both but I can not switch the www.rt112media account to show the non www. account as the main one because I have the other pending. My site is still being crawled as 2 versions rt112media.com and route112media.com. So what is my best option? And what would be the worst cause scenario if I wanted to start completely over using route112media.com as my main domain with hosting and all. Sorry this was so long I just wanted to explain my situation. I'm lost. Any advice would be appreciated! http:/rt112media.com
Technical SEO | | Route112Media0