301ing entire E-Com website - Using TopPages Report as a Guide
-
Hi Folks,
My company is in discussions with an ERP provider to migrate our existing website to a new backend system, new url structures..the whole 9 yards.
We have over 15,000 products, and a lot of "odd" url structures created by an outdated system that we were unable to adjust. All and all, if you're talking about a raw url count, it's in the 100s of thousands.
During discussions, we were told that bulk 301 redirects would be a problem. They could be performed manually though (greaaattt).
Due to this, I ran an OpenSite Explorer report, and isolated our top pages. After exporting the CSV, I was able to breakout "all" urls that have links from other domains.
My question is, has anyone used the OpenSite Explorer on a website of similar size, to form the basis of a migration? Do you have enough confidence in the tool to use it in this way, or should we re-negotiate our agreement until a way can be found to mass 301 ALL urls. I'm at least a little concerned that OpenSite Explorer isn't indexing all of the links out there. Gasp..or would there be a better tool to accomplish what I'm trying to do?
Thanks!
-
As much as we love OSE here, it is not a good bet for doing a complete inventory of your entire current site. I'd probably recommend a desktop crawler, like Xenu or Screaming Frog. See my comparison post here:
http://www.seomoz.org/blog/crawler-faceoff-xenu-vs-screaming-frog
I've got to believe that there's some logic that could connect the old and new URLs, though, even if it has to go through a database look-up. Creating 15,000 manual redirect rules isn't only going to be a huge pain, it may cause a huge processing bottleneck. I'd really push back on what "can't" means and why it can't be done. Too often, "can't" is code for "don't want to", in my experience.
-
OK...that makes it more difficult.
I was hoping that you might have some files whose filenames would be retained and would only need to move from one directory location to another within your new site structure.
Since it is possible to redirect the entire contents of a directory to another directory with a single line of code, this would have made it easier.
Sha
-
Hi Sha, thanks for your response.
1. Yes, we will use the same domain but structure will be completely changed.
2. Unfortunately, our current CMS is so backward, that it will be a complete file name and, directory change.
Thanks!
-
Thanks..great answer..and yeah, that's pretty much how I feel with that last sentence..ugghhh..
-
Just to clarify what you are doing here, a couple of questions:
- ... am I correct in assuming that you are wanting to use the same domain, but the site structure will be changed?
- Also, will there be ANY pages within the new structure that might simply be moved to a different location within the same domain (for example move from root directory to /sub directory), but retain the same file name?
These things will make a difference as to how you can approach the issue.
Sha
-
As far as I can tell, Open Site Explorer doesn't show all the links - in fact it shows only a very tiny proportion of the links to your site. Yahoo site Explorer, while it's still available, is a more accurate list of links to your site. For example on our little site, OSE shows 30 in bound links, but Yahoo shows almost 300!! As painful as it may be, I would 301 every page, but do them in SE Rank order, it only has to be done once, and when it's done it's done. That said, I'm surprised your web company can't find a way to automate it?!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
.com vs. .us for the same company in the US?
How does google react when there is a .com and a .us in the same geographic area as with the United States? Wouldn't google prefer the .com over the.us? Even with different content on the site, I would think google would choose one over the other. Would you have to use a 301 redirect or would just geotargeting do it? I'm not interested in using both just to use them, there is discussion between a US corporation and it's US region.
Moz Pro | | CC_Dallas0 -
Authority from Linking Root Domains: youtube.com / wikipedia.org / adobe.com
Hi there, Presently doing competitor analysis and note two competitors who have a way higher 'moz domain authority' than my client. Using moz tools I notice their top 5 linking root domains all have a score of 100. Refer to screen shot. Of note, both list youtube.com and _wikipedia.org. _ Similarly, my client's domain is ALSO linked from their user profile on youtube.com. They also have a published wiki page with their URL linked. BUT, youtube.com or wikipedia.org are not listed in their "top 5 linking root domains". Their highest scoring linking root domain is prweb.com - with a score of 97. If my client has links on these top domains why would they not be listed in my client's top five domains list like they are listed in their competitors top five? Researching for reasons I came across this old post (2009) here - http://moz.com/blog/followed-links-from-four-unexpected-sources - and wonder if the competitor's links are 'followed' links - even though all resources suggest wiki and youtube are definitely 'no follow' links? Other interesting "Top 5" domains that are listed for my competitors as top "linking root domains" are microsoft.com, adobe.com and europa.eu - again, refer to screenshot. Questions are IF these top linking root domains are in fact 'followed' links/valuable links and help with domain authority scores calculated by the moz tool then 1) HOW do I get these links to show/provide the same value? AND 2) How are my competitors, who are simply travel products, getting links from top domains like adobe.com? I do hope all the above makes sense and that I'm using/interpreting the moz comparative tool correctly! Cheers iGe864i.jpg?1
Moz Pro | | catherineh0 -
Rank Report Not Updating
The ranking tool indicates that a new rank report will be generated every Tuesday. My last report was on November 15th. It is now November 25th. It missed last week. Should I report something wrong or is this normal? How do I keep it updating on a weekly basis like it's supposed to? I checked in settings to see if I had done anything wrong and couldn't find anything. Regards, Dino
Moz Pro | | Dino640 -
Can I set Up Multiple Campaigns For Same Website?
I would like to set up one campaign for my main site example.com and another campaign for example.com/blog. Is it possible? I don't want crawling to overlap for these two separate campaigns.
Moz Pro | | jombay0 -
Bing Not Complete in Ranking Report
Curious as to what the "FRI" image means under Bing on my Keyword Ranking reports? I saw this on Friday and assumed it hadn't crawled yet (as it was to set to crawl on Friday Jan 27, 2012) but here we are Monday AM and I'm still seeing the same thing. Glf4F.jpg
Moz Pro | | QueenSt0 -
Changing Date Range in SEOMoz Campaign Reports?
Hey, I'm trying to create some old reports for a client and wanted to see how I can adjust the reports to a specific timeframe so I can view the statistics & changes between that time frame. Is this possible?
Moz Pro | | SavvyPanda
Thanks!0 -
In competitive domain analysis my website shows pages that I no longer have.
When I go to my campaign, link analysis, under competitive comparison/followed backlinks, the 5 pages under Anchor Text/Target URL, supposedly on my website, are not on my website anymore. I recently moved my domain name to another server (before signing up for seomoz) and deleted the forum associated with my website. Those 5 pages are all from that now extinct forum. What's going on?
Moz Pro | | ovistomih0 -
A tool for seeing all the keywords a website ranks for
As title, is there a tool out there that will allow you to see all the keywords a website ranks for in the first few pages of a particlur search engine? I would be particularly interested for keywords in the first 10 pages of Google. Thanks
Moz Pro | | blagger0