301ing entire E-Com website - Using TopPages Report as a Guide
-
Hi Folks,
My company is in discussions with an ERP provider to migrate our existing website to a new backend system, new url structures..the whole 9 yards.
We have over 15,000 products, and a lot of "odd" url structures created by an outdated system that we were unable to adjust. All and all, if you're talking about a raw url count, it's in the 100s of thousands.
During discussions, we were told that bulk 301 redirects would be a problem. They could be performed manually though (greaaattt).
Due to this, I ran an OpenSite Explorer report, and isolated our top pages. After exporting the CSV, I was able to breakout "all" urls that have links from other domains.
My question is, has anyone used the OpenSite Explorer on a website of similar size, to form the basis of a migration? Do you have enough confidence in the tool to use it in this way, or should we re-negotiate our agreement until a way can be found to mass 301 ALL urls. I'm at least a little concerned that OpenSite Explorer isn't indexing all of the links out there. Gasp..or would there be a better tool to accomplish what I'm trying to do?
Thanks!
-
As much as we love OSE here, it is not a good bet for doing a complete inventory of your entire current site. I'd probably recommend a desktop crawler, like Xenu or Screaming Frog. See my comparison post here:
http://www.seomoz.org/blog/crawler-faceoff-xenu-vs-screaming-frog
I've got to believe that there's some logic that could connect the old and new URLs, though, even if it has to go through a database look-up. Creating 15,000 manual redirect rules isn't only going to be a huge pain, it may cause a huge processing bottleneck. I'd really push back on what "can't" means and why it can't be done. Too often, "can't" is code for "don't want to", in my experience.
-
OK...that makes it more difficult.
I was hoping that you might have some files whose filenames would be retained and would only need to move from one directory location to another within your new site structure.
Since it is possible to redirect the entire contents of a directory to another directory with a single line of code, this would have made it easier.
Sha
-
Hi Sha, thanks for your response.
1. Yes, we will use the same domain but structure will be completely changed.
2. Unfortunately, our current CMS is so backward, that it will be a complete file name and, directory change.
Thanks!
-
Thanks..great answer..and yeah, that's pretty much how I feel with that last sentence..ugghhh..
-
Just to clarify what you are doing here, a couple of questions:
- ... am I correct in assuming that you are wanting to use the same domain, but the site structure will be changed?
- Also, will there be ANY pages within the new structure that might simply be moved to a different location within the same domain (for example move from root directory to /sub directory), but retain the same file name?
These things will make a difference as to how you can approach the issue.
Sha
-
As far as I can tell, Open Site Explorer doesn't show all the links - in fact it shows only a very tiny proportion of the links to your site. Yahoo site Explorer, while it's still available, is a more accurate list of links to your site. For example on our little site, OSE shows 30 in bound links, but Yahoo shows almost 300!! As painful as it may be, I would 301 every page, but do them in SE Rank order, it only has to be done once, and when it's done it's done. That said, I'm surprised your web company can't find a way to automate it?!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Ranking report orderng when exporting to pdf
When I am in my rankings report I like to view the results in order of ranking, so that the keywords with higher position in google for example appear at the top, which is great. However when I export it to PDF it seems to default back to appearing in alabetical order... is there a way around this? Thanks!
Moz Pro | | stardigital0 -
Keywords for Whatafy.com
Hi guys, I own whatafy.com, we translate the articles from my romanian website dli.ro. I'm working on a script for subdomain ask.whatafy.com Whatafy = We Have All The Answers For You Now i'm stuck in seomoz, because as you can see we have articles from over 40 domains, and is a general online magazine with articles. What keywords should i use for main domain ? What competitors to enter in those 3 options so i can track and beat them. Should i make another campaign for ask.whatafy.com when is ready ? or the main campaign have some options to track subdomain to ? I have same situation with dli.ro where in subfolders i have different scripts like, web directory, companies listing, dreams interpretations, illustrated jokes, text jokes, driving licens test, online test for fun, postcodes, wheater, big forum, maps, ecards etc. Is a big portal with everything, and for each subfolder i targeted severel keywords, i need to make a campaign for each folder ?
Moz Pro | | whatafy0 -
How to rank 1000s of subcategories [E-commerce]
Hi guys, I run an eCommerce store that has 1000s of subcategories, yes it's a lot but my niche requires that many. Using Traffic Travis, SEOmoz and other tools I can say that these are Easy/Very Easy to get ranked for. (Sounds good, but it's not that easy) If I'm honest my site has on site SEO done however I don't have unique content on each of the sub categories as it would take to much time, should I spend my time adding unique content to each one? I also need to increase page authority to my inner pages, how can I achieve this? My competitors on each subcategory are linking to there other subcategory should I do the same? I'm just not sure how deep linking works. My niche is printers/ink that's why I need lots of subcategorys however I'm just lost on what to do at the moment and I really need to increase sales! Thanks for reading.
Moz Pro | | Superinks0 -
My rankings report is giving out wrong information
Hi, i am very puzzled about the rankings report. For some reason the past couple of weeks it is giving wrong information for example, my site www.in2town.co.uk the report says that the keyword gastric band hypnosis is eight in google on page one but when i have checked i cannot find it. It also says the word gastric band hypnotherapy is sixth place in google on page one can anyone please let me know what is going on
Moz Pro | | ClaireH-1848860 -
SEOmoz Dashboard Report: Crawl Diagnostic Summary
Hi there, I'm noticing that the total errors for our website has been going up and down drastically almost every other week. 4 weeks ago there were over 10,000 errors. 2 weeks ago there were barely 1,000 errors. Today I'm noticing it's back to over 12,000 errors. It says the majority of the errors are from duplicate page content & page title. We haven't made any changes to the titles or the content. Some insight and explanation for this would be much appreciated. Thanks, Gemma
Moz Pro | | RBA1 -
How to download an entire Website (HTML only), ready to rehost
Hi all, I work for a large retail brand and we have lots of counterfeit sites ranking for our products. Our legal team seizes the websites from the owners who then setup more counterfeit sites and so forth. As soon as we seize control of a website, the site content is deleted and subsequently it falls out of the SERPs to be immediately replaced by the next lot of counterfeit sites. I need to be able to download a copy of the site before it is seized, so that once I have control of it I can put the content back and hopefully quickly regain the SERPs (with an additional 'counterfeit site' notice superimposed on that page in JS). Does anyone know or can recommend good software to be able to download an entire website, so that it can be easily rehosted? Thanks FashionLux (Edited title to reflect only wanting to download html, CSS and images of site. I don't want the sites to actually be functional - only appear the same to Google)
Moz Pro | | FashionLux0 -
Will Social be Incorporated into the New Reports Interface
Just wondering if there are plans to integrate the social media reporting section with the new "Reports" section. Having a social section in the new Reports interface that could show weekly/monthly/yearly Facebook and Twitter interactions would be awesome to have all in one PDF report with the rest of the reporting options.
Moz Pro | | noBulMedia0 -
How to track with SEOMOZ a website in several language
Hi, We have a customer with a website in EN, FR and ES. They used Joomfish, so each language is in a subdirectory : sitename/en sitename/fr sitename/es and they want their website to be well placed on the web for all that languages and countries: English, French, Spanish, German and Italian. It is a website for specific affiliation, that's why there is no barriers. What I need to do to use the best way SEOmoz. For the moment I created one campaign following Google US, google Germany and Google France. To go deeper, I would need to create different campaigns in my account? And also, your robot will be able to recognize the different subdirectories and languages? And to improve the SEO of this website, it wouldn't be better to have 3 domains name, one for each country? Thanks a lot in advance for your answer, Anne
Moz Pro | | ahernoux1