480,000 Redirects - Is this hurting my SEO? PLEASE HELP!
-
Hello everyone,
I have over 480,000 internal rewrites in my Magento site. The reason I have so many is because I have over 1,500 products on my site and I update inventory every day via Bulk Import Extension. For the first few months I didn't realize that the URL was changing by a single digit every time I imported the .xml with new inventory counts. This of course created thousands and thousands of 404s.
I figured out how to avoid the digit change and then I started redirecting the 404s via a Bulk Rewrite Extension. I managed to rewrite over over 50,000 404s but new ones still pop up every day and there is no end to them in sight.
My traffic is terrible. Only about 40 organics daily. It's been like that for months. I can't get it off the ground and I think it's because of this excessive rewrite and 404 issue.
My question is, does having so many internal rewrites and 404s hurt my SEO efforts?
Would it be better just to start from scratch with a new site, new domain, new everything?
Please help me. I'm going crazy with this. Thank you.
Nico.
-
Hello Nicolas,
You're welcome! I am glad you found the answer helpful. I direct the SEO strategy for seOverflow, and yes we do work with small businesses. Fill out our contact form and we'll be in touch. You can also look into other reputable SEO agencies and freelancers listed here on Moz.com.
Nice site.
-
Thank you Everett. You don't know how much this helps me. I was dreading having to start the site from scratch, so I will continue with the one I have and work on it for as along as it takes. This is the site by the way: http://devilswink.com/
Do you offer SEO consulting services for small businesses in the U.S. Everret?
-
Nico,
Great question. Technically speaking, a permanent 301 redirect should stay up indefinitely. However, I have heard more than one Google employee say publicly that they should stay up for "at least a year". At that point I think you can take them down and the destination page will retain the link juice from the old links since Google will have supposedly updated their link graph. However, I don't trust that most Google employees really know what's going on under the hood all the time, and recommend leaving any redirects from pages with external links in place for as long as you have control over it (e.g. you obviously couldn't leave them in place across domains if you sold the old domain).
If the page doesn't have any internal or external links pointing to it you can safely remove the 301 redirect at any time. A year would be plenty.
-
Hi Everett,
Thank you very much for your feedback.
This does put me at ease because I was ready to pull the plug and start a new site from scratch.
Quick question, do old Rewrites disappear after a while? In others words, do they keep getting crawled?
If so, can I deleted them after a few months for example, or after a year, or do search engines need them to exist permanently because other wise they would generate new 404s?
Thank you.
Nico.
-
Hello Nico.
I think I have some good news for you. Unless there is live link to those URLs (internal or external) there is no need to redirect them. In my experience more than 99% (an educated guess) of product pages do not have any external links. So assuming you have not cleaned up your internal linking (if you haven't, you should) there really is no need for the 301 and you can just let it resolve as a 404.
As long as the old URLs return a 404 status code they should be removed from the index within a matter of weeks. However, if they don't have any external or internal links - again, most of those pages probably do not - it may take months for Google to decide to recrawl an indexed page without any link paths to it. Googlebot couldn't just "crawl" its way there, but would have to retrieve the URL from a database just to check it, which would take longer. I have a tested and recommended solution to this issue, which can be found here on the Moz.com blog.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Redirecting a blog
We've acquired another company and want to redirect their soon-to-be-obsolete website to ours. It includes a blog with many blog posts. Should we: only 301 redirect the top level blog URL
Technical SEO | | Caro-O
try redirect individual blogs to blogs of a similar topic on our site (least practical I'm sure)
redirect all their individual posts to our main blog URL Thanks, Caro1 -
Redirect domain without losing SEO benefit,
Now my website need to change to new domain, Since we start this website we have the landing page for sale and blog. So I need to redirect both a.com to b.com and a.com/blog/ to b.com/blog/ and I need to do by these step to keeping the benefit of SEO. For a.com Preparing the new site by duplicate the information of old site. (Get them no-index, no-follow) Export all URL to excel files by Xenu then look up together for re-check the information are they the same or not, I think we can check that if we used the same title. Redirect together by 301 codes. Get google bot know by submission to Google Webmaster Tools (Google Search Console) For a.com/blog/ Since we used wordpress to be our blog CMS, So we need to install wordpress CMS to b.com/blog/, Then backup SQL from PHP C Panel & files. Re-upload that SQL database & files to new server. Export all URL contain /blog/ then look up together by excel again. Redirect by 301 codes. So for this method what am i wrong or need to change please suggestion me. According to this is the technical SEO stuff that I never done before. After we redirect the old domain to new domain how much time Google will take for checking and give the benefit for us with the same benefit. And what we have to do for Moz.org to checking our issues & ranking. Plus - what can we do for no-index, no-follow page that belong to a.com because my website also doing these page as well for each marketing campaign to avoid Google to index.
Technical SEO | | ASKHANUMANTHAILAND0 -
Is dash problem for seo?
My web site http://www.green-lotus-trekking.com is this problem for google search engine optimization? Some little percentage problem or totally I am in Confusion?
Technical SEO | | agsln0 -
Do rss feeds help seo?
If we put relevant RSS feeds on a site, will it help the SEO value? Years ago, I shied away from RSS feeds because they slowed the site down and I didn't like relying on them. However, the past couple years, the Internet has become better, especially in Alaska.
Technical SEO | | manintights280 -
Does Quantcast interfered with SEO?
Quantcast (http://www.quantcast.com/), a stats program was removed from my clients website because the former SEO consultant said it interefered with his SEO efforts, claiming the google bots weren't reading it right. I have never heard of that before and my client now wants Quantcast back on their website. Has anyone heard of this problem with Quantcast?
Technical SEO | | StreetwiseReports0 -
301 redirects
At the moment it's possible to access the home page of my website via two different urls, with and without www. and you've told me that this can be resolved with Canonicalization and a 301 redirect. Do I do this with my web hosting package or in my html pages? If I can't do it with my web host (1&1) then is there an idiot's guide of how to do it yourself? I've also got both the domain vamospaella.co.uk and vamospaella.com. Is it better to have one of these redirecting to the other for UK traffic (at the moment .co.uk redirects to .com) Thanks
Technical SEO | | melissa10 -
301 Redirect
Hi there, We are re-branding & re-structuring our website, there will be quite a number of 301 re-directs, possibly hundreds. The question is: Should i wait until the re-branding has been completed and do al the 301's in one go?, or should I try and do 301's as i go along? Kind Regards
Technical SEO | | Paul780