Advice urgently needed on best practice for handling multiple product categories on Magento website
-
I have an ecommerce site built using Magento and urgently need advice on best practice for handling multiple product categories (where products appear in more than one category on the site creating multiple URLs to the same page).
In April this year, based on advice from my SEO who felt that duplicate content issues were causing my rankings to be held back, I changed about 25% of the product categories to 'noindex, follow'. This has made organic traffic fall (obviously) as these pages fell out of Google's index. But, contrary to what I was hoping for, it didn't then improve rankings - not one iota, nothing - which was the ONLY reason why I did this. This has had a real negative impact on sales, so I'm starting to think this was actually an a terrible idea.
Should I change them back?
And to ask a wider question, what is best practice for this particular scenario?
-
Hi,
If there already is a canonical link then you can edit it using the layout update code I first mentioned. If you do not need to canonical to another page you can just leave it as it is (self referencing).
As to if you want to do it or not, this really depends on how big of a problem it is for your search efforts and how many cats/products you will need to manually adjust. I would think that if you keep track of them in an excel and remember to check when you are updating that with a couple of hundred categories/products (of which only maybe a couple dozen or less might have to be manually edited?) then you should be able to manage it ok.
Good luck!
-
Thanks, I have regenerated the xml sitemap. Fingers crossed it doesn't take too long to see the pages fall back into the index!
As it happens, my developer has since emailed back to say that there is a canonical link for each category but it points to itself. Is that a problem?? He can't tell me.
Thinking about it, I'm unsure about manually adding a canonical link for each product/category. I'm concerned about errors creeping in over time, with URL changes, etc. With hundreds of products, I think it won't be too difficult for this to happen. Plus, the XML is automatically generated, so don't think the URLs will match. Have you had encountered these problems before?
-
HI,
For the canonicals if they are not being added automatically at the category level then you can still do it just removing the first part of the above that removes the old url, so like this:
<reference name="head"><action method="addLinkRel"><rel>canonical</rel>
<href>http://www.domain.com/canonicalUrl</href></action></reference>The above will add a canonical tag to whichever category page you add it to (in the layout update box).
The fetch as google does not reindex your site, it just previews how google sees the site. Make sure all the category pages are included in your sitemap and resubmit the sitemap to GWT. You can then see how many pages in the sitemap are indexed and that number should go up as google recrawls the site and finds the noindex tag removed.
-
Thanks for taking the trouble to answer. I have now made all categories 'index, follow'.
No canonicals are automatically added to category pages, so can't use this technique. Thanks for the suggestion, though.
Should I 'Fetch as Google' in WMT? If so, is it best to add the URL for every single category that I've updated? Or, just wait?
Appreciate your help, Lynn.
-
Hi,
I would do it all at once, nothing unusual about it and google may not see the change on all pages at the same time anyway.
For the rankings it is really impossible to say, you might get lucky, you might have to be patient, its not exactly like starting over again, especially if you have a couple of existing external links but....
For the canonical tags, there is a way to do it depending on your setup. Have you got canonicals being automatically added to the category pages as well as the product pages? If yes then you can overwrite them on a case by case basis by putting the following code in the 'custom layout update' box (this works for both products and categories actually).
<reference name="head"><action method="removeItem"><type>link_rel</type>
<name>http://www.domain.com/oldurl</name></action></reference><action method="addLinkRel"><rel>canonical</rel>
<href>http://www.domain.com/new-url</href></action>You will need to identify the canonical url being inputted into the code, add it to the oldurl bit above to remove it and then put in the new canonical url you want. Needless to say, it pays to be sure about what you are trying to achieve and why before implementing this setup on a lot of pages.
Hope it helps!
-
The website uses Magento version 1.4. which actually does have the canonical link back to the base URL feature. This was in place already before I started even messing around with making these changes.
I will revert the categories back to 'index, follow'. Some questions about this:
- Is it best to do it all at once (or will this look odd/'unnatural' somehow from Google's perspective)
- How long will it take for these pages to re-rank? They were made noindex in April, so would it be like starting again as if these were totally brand new pages?
Another SEO has recommended another approach, which is to identify the 'best' URL (from SEO point of view) and add the canonical link to the rest. Is there a way to implement/manage this easily in Magento? I can't seem to find a solution online on this.
-
That Yoast plugin is only developed up to Magento version 1.4 which is pretty old now. The good news is you can get some of this functionality out of the box now at Admin -> Configuration -> Catalog -> Search engine optimizations. If you set the use canonical meta tag link on products to yes then all product pages are given a canonical link back to a base url with no category in it. Baring a more advanced paid module or custom development, this is going to be your best bet.
Certainly change your category pages back to index, follow. Depending on your setup and how many common categories/products you have any duplicate content issue you have would usually be on a product more than a category level anyway. For category pages look at getting some good descriptions and other unique content on them. Check out this video for more details.
-
Change them all back to INDEX, FOLLOW and use Canonical plugin by yoast.
Canonical URL's for Magento • Yoast (sorry if links not allowed)
Some products on our site appear in six categories and we have no issues with duplicate content whatsoever using the above.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Best Practices For Angular Single Page Applications & Progressive Web Apps
Hi Moz Community, Is there a proper way to do SPA (client side rendered) and PWA without having a negative impact on SEO? Our dev team is currently trying to covert most of our pages to Angular single page application client side rendered. I told them we should use a prerendering service for users that have JS disabled or use server side rendering instead since this would ensure that most web crawlers would be able to render and index all the content on our pages even with all the heavy JS use. Is there an even better way to do this or some best practices? In terms of the PWA that they want to add along with changing the pages to SPA, I told them this is pretty much separate from SPA's because they are not dependent. Adding a manifest and service worker to our site would just be an enhancement. Also, if we do complete PWA with JS for populating content/data within the shell, meaning not just the header and footer, making the body a template with dynamic JS as well would that effect our SEO in any way, any best practices here as well? Thanks!
Technical SEO | | znotes0 -
Best Practice Out-of-Date Sales and Events
Hi Everyone, http://www.palaceresorts.com/cozumelpalace/en/cozumel-ironman-triathlon I found an out-of-date event in the clients' crawl report that returns a 404 not found Status Code. I remember to have read an article advising webmasters to don't ever remove a single landing page, but instead to advise that the sale/event it's expired and some information about the upcoming event. Does anyone have had this experience before ? Could you provide me with a real case scenario. Thank You
Technical SEO | | Ariadna-US0 -
How do I optimize a website for SEO for a client that is using a subdirectory as a seperate website?
We launched a subdirectory site about two months ago for our client. What's happening is searches for the topic covered by the subdirectory are yielding search results for the old site and not the new site. We'd like to change this. Are there best practices for the subdirectory site Specifically we're looking for things we can do using sitemapping and Webmaster tools. Are there other technical things we can do? Thanks you.
Technical SEO | | IVSeoTeam120 -
Need very urgent advice on Wedsite Migration questions please.
Good afternoon, I am in the middle of re branding my Computer Repair Business that has been established for the past 5 years now and does very well in GOOGLE for all things computer repair search related queries. I have a done tons of research on the Migration process and all elements involved for the past month now and I have been doing SEO for the past 5 years and am quite knowledgeable and very fluent with search engine optimization. I have a bit of a unique situation going on in my particular instance. Not only am I re branding the business and trying to maintain my GOOGLE rankings trying to pull this off at the busiest time of the year (summer months) but I am also going to be physically relocating my business after the busy (Summer Season) from my current location of Wilmington, NC to Charlotte, NC. Yes, I do understand that Winter would have been the best (time) to do all of this massive changing around but, my hand is forced and this is being done out of necessity for monetary survival purposes and I really have no choice in the matter currently! With that said here is my dilemma. I am setting up a SILO Site Architecture using the "Thesis Framework" and WordPress which will be an improvement by 5 fold of what I have in my current well established JOOMLA site that has done very well in GOOGLE Search these past 5 years (all first page results) for anything (Computer Repair) related in Wilmington, NC. So, I am trying run damage control on this situation and I have a number of questions that need a strategic well thought out answer from a different perspective on this matter. 301 Redirect question: I want to include my geo targeted location in my URL String as it has served me well in the pass however, seeing how I am going to be Physically relocating myself and the business to Charlotte, NC from my current location of Wilmington, NC after the summer months what will I need to take into consideration with this situation in regards to the 301 redirect? _ "If I include my current location (Wilmington NC) in the destination (New Domain) URL string for any given 301 redirect from my existing website to the new website and then physically move to another city 3 months later is this setting myself up for a BIG Failure??"_ Seeing how I have no idea of how this technically works with GOOGLE as far as how long this (migration process) takes to Fully complete where the OLD domain completely drops off and everything is Fully passed over to the New Domain in terms leaving the 301 Re directs in place on the Old Domain Server. How long does this process usually take with GOOGLE? Information that you should know: This is my First Experience doing a Site Migration! The NEW DOMAIN is on a Different Server and IP I will be performing 301 Redirects on a Page to Page Basis! I DO plan on keeping the Old Domain Server Account online for 4 months after the migration process. Both OLD and NEW domains are on HOST GATOR (separate accounts) I am Migrating from JOOMLA to WordPress I am using the Thesis Framework for the new WordPress site (New Domain) I have created and established a well thought out SILO Site Architecture for the (NEW DOMAIN) using Parent and Child Pages in WordPress (not posts) supported by many hours of keyword research for my SILO Themes I am changing My Existing /computer-repair.hml URL Structure to WordPress **/computer-repair/ ** remember.. (using WP - Pages) not posts! I am re branding my Company business from Community Computer Repair to PC Medics On Call I am reducing my on page Content because it is too long in the Tooth for my customer base and although the search engines love it, in it's current state (long winded and well written) it is having a negative effect on the people that actually pay my bills (my customers) but my new Site Hierarchical Structure will rectify a lot of the negative fall out from this change that would otherwise kill me in the search rankings from doing this. In addition to being an proficient SEO I am also a developer and a coder. The New Domain is Currently ALLOWING only my IP Address while I sort this out and until I complete the new site structure and get the content and ON Page done. For the Destination Domain URL Structure, is including my current City (Wilmington NC) going to be an issue with the 301 Redirects seeing how I am moving to Charlotte NC around September? Having the Geo Targeted City in my URL Structure will help offset some of the damage caused by the changes that I need to make. Plus, the URL looks less spammy looking at the examples below when icluding location after the keyword phrase **Example -1 - ** VIRUS REMOVAL SILO With GEO Targeted Location after Keyword http://www.pcmedicsoncall.com/virus-removal-wilmington-nc/malware-removal/ Without - GEO Targeted Location after Keyword http://www.pcmedicsoncall.com/virus-removal/malware-removal ** Example -2 -** COMPUTER REPAIR SILO With GEO Targeted Location after Keyword http://www.pcmedicsoncall.com/computer-repair-wilmington-nc/laptop-repair/ Without - GEO Targeted Location after Keyword http://www.pcmedicsoncall.com/computer-repair/laptop-repair/ As far as the potential problems with icluding the Wilmington NC in the Targeted URL destination for the 301 Redirect and then changing my Actual City location for the business 2 1/2 - 3 months later is this going to be an issue? Pertaining to the 301 redirect question above, how exactly would I handle this if I used Wilmington, NC after the Keyword when I initiate the 301 Redirect to the site? Can I later change this in the OLD Domain .htaccess 3 months later to reflect the Charlotte Location and also do the necessary 301 Redirect in the NEW DOMAIN to reflect the permanent move? I hope I have not confused this any by the way that I am asking? Here is a screen shot of the NEW DOMAIN layout for the Links below and above. NOTE: Currently, ALL Silo Menu Themes have - wilmington-nc/ incorporated after the targeted Keyword http://www.pcmedicsoncall.com/virus-removal-wilmington-nc/malware-removal/ http://www.pcmedicsoncall.com/virus-removal/malware-removal SEOMOZ-PC-MEDICS-ON-CALL-1.jpg SEOMOZ-PC-MEDICS-ON-CALL1.jpg
Technical SEO | | MarshallThompson310 -
Website not crawled
i added website www.nsale.in in add campaign, it shows only 1 page crawled. but its working fine for other sites, any idea why it failed ?
Technical SEO | | Dhinesh0 -
Website redirects
We consolidated websites. All the international sites have been brought under the roof of our mothership site based in the US: www.crisisprevention.com ... We mapped out all of the URLs and where they should be redirected. However, if someone types in, say, www.crisisprevention.co.uk it redirects to the mothership site, BUT the old URL hangs around no matter what page you navigate to. I feel like it has duplicate content ramifications or worse. I would like opinions on this, so I can take my findings to IT and figure out a solution. Here’s another example: http://www.positive-options.co.uk and another http://www.positive-options.com
Technical SEO | | spackle0 -
Certain product ranking higher than category (ecommerce)
Hi all, I'm a bit stumped on a SERP. The product is ranking higher than the actual category. Is there anyway to fix this? When I type in "category111", I get the product link instead of a link to the general category. It would be "productname category111" and link would point to product not category. Hope that makes since! TIA
Technical SEO | | William.Lau0 -
Best way to Handle Pagination?
At the moment I my blog is paginated like so: /blogs > /blogs/page/2 > /blogs/page/3 etc What are the benefits of paginating with dynamic URLs like here on SEOmoz with /blog?page=3
Technical SEO | | NickPateman810