Magento- Temporary Redirects

[CanyonOS]

Hey guys!

My organization just launched an eCommerce site and we are receiving a lot of temporary redirect issues. How do you solve this issue (36k of them) within Magento Enterprise?

1. All settings have been changed to 301 redirects but I am still receiving the same errors during my crawl report.

2. Website URL = www.CanyonOS.com

Any support or advice is greatly appreciated! Oh and if you need any toner, you know where to go :)!

Sincerely,

[Carson-Ward]

The errors are appearing because users are immediately redirected to the login page. It doesn't actually matter whether these are 301 or 302 redirects because you're not looking to pass link equity anyway. The easiest way to deal with this is to tell crawlers (like Moz's and Google's) to ignore stuff they couldn't see anyway because it's only shown to logged-in users.

I generally block the /customer/* folder in robots.txt to avoid issues like this. And if you have a wishlist in the primary nav that's worth blocking, too. You could also just remove the Wish List link when users aren't logged in. The idea is to tell the crawlers to avoid any portion of the site where a login is required. So you could just upload a text file to canyonos.com/robots.txt that looks like this:

user-agent: *

disallow: /customer/

disallow: /wishlist/

These lines will block the entire folder, so you should only do it if there's nothing in the folder that search engines can see. In other words, use this line if everything in the folder is behind a login (it usually is in Magento).

Google's info is pretty good here:

https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt?csw=1

[CanyonOS]

Hi Umar,

Thank you for your response. We moved from an old WP site that we only used for B2B content, the site did not have any product content. We currently use MageWorx SEO Suite, but we have been unable to fix the redirect and duplicate page content issues.

Our last crawl report (moz) showed that we reduced the errors from 36k to 24k. All of the redirect issues are from wishlist, checkout, and comparing URLs.

Any suggestions?

Thank you for all your help!

[UmarKhan]

Hey Bryce,

First of all best wishes for your site and I'll surely visit it to get a toner if you give me a good discount

Coming to your question, is it a new site or you moved the old one? For dealing all the redirection issues, my developer usually go with this extension and it's pretty good,
http://www.magentocommerce.com/magento-connect/optimise-web-s-mass-301-redirects-for-404-pages.html

Could you please tell us which crawler report you're referring to, is it a Moz crawler or some other one?  And, when you fixed it? As sometimes, it does take some time to report things correctly.

Umar