Site Migration and Traffic Help!
-
Hi Moz,
I recently migrated my website with the help of an SEO company using 301 redirects. The reason for the move was to change our CMS from .aspx to Drupal/Wordpress. The homepage (www.shiftins.com) and the blog (www.shiftins.com/blog) were the only two pages that kept the same url. Everything else was redirected. It's been about two months since the redirects were completed and traffic has dropped off about 90%. I'm starting to worry that something was not done properly and my traffic may never return.
The process for the redirects seem correct when I checked the work the SEO company did. All pages were duplicated, redirected to individual pages, then the old pages were de-indexed. Are there any insights the community can provide? Please help!
-
-
_Just curious what section of the Analytics data are you looking at to make this determination? _
(1) I looked at GA reports, Audience > GEO > Location > United States > California.
(2) I looked at a download of GWMT impression data comparing 9/28 - 10/30 to 10/31 - 12/1 data, sorted by the calculated difference in impressions data.
(3) Then went back to GA, looked at landing pages and searched for "car".
All of the pages I used to have were supposedly moved over to the blog then 301'ed. Was this really not done or were the pages not optimized properly?
I don't know if all pages were moved and properly 301'd. I did see at least one error though. /automobile/car-insurance-program.aspx redirects to /drive_to_learn_scholarship, which obviously is not the correct URL.
Are all of these duplicate pages coming from the blog? How can I identify these?
The screaming frog scan that Thomas sent should help you identify them.
_If you want the list of queries that were driving impressions before the conversion (and now aren't), email me (so I get your email) and I'll pass them along. _
I've emailed you the file.
-
Hi Donna,
Thank you.
The report is something you can customize to be completely white labeled very easily in less than 10 minutes. The tool is https://www.deepcrawl.com it starts at a very reasonable rate $80 and is capable of so much.
I would recommend Deep Crawl to anyone there fantastic.
All the best,
Tom
-
Thanks for clarifying the point about duplicate hits.
-
Excellent summary Thomas. Is that custom or are you using a paid tool to generate that?
-
All done use the URL provided to go through every issue on your site. remember you can click on anything to see more there are thousands of problems you can look directly at and see a fix for.
IN the URL
You will see green arrows to click on you can also click on anything highlighted in red or if there is a word for a number member you can click on it and see a lot more than what you see in the very beginning.
You have a lot of broken links it also appears your canonical URL is non-www but you 301 redirect to www.
USE THIS URL TO SEE EVERYTHING:
UES THIS FOR A summary http://d.pr/f/bvxB
Sorry it took me so long
Tom
-
so far if you look at the Google analytics indexed URLs and site map URLs compared to the URis downloaded you should upload the site map I gave you in the last post screaming frog XML sitemap with a XML image sitemap will be a step in the right direction.
It is a larger photo
http://i.imgur.com/IIhIx7q.png
Tom
-
Here is a photo showing that deep crawl is hard at work.
I've also added this URL which has a zip file that contains all your URLs your screaming frog crawl review and the pages that contain Google analytics the pages that do not and what UA number is attached to the page. http://d.pr/f/1f1AL
I want to clear one thing up you cannot get duplicate hit's using Google analytics twice on one page as long as the UA numbers are different the only thing that will happen is your bounce rate will go down dramatically. ( I am talking about full JavaScript snippets) can have two UA's in the same snippet and be okay.
I started to crawl here is a bigger photo I will post it to you when I'm done I will look at the information I've sent you so far I think you will find it very valuable.
http://i.imgur.com/i0F739b.png
All the best,
Tom
-
"The vast majority of the lost traffic is from local (LA, San Fran & San Diego) locations. People searching for "car insurance", "cheapest car insurance", "cheapest car insurance California" and other similar keyword phrases. You no longer have a page on your site optimized for those terms so you're not showing up in search results. "
Just curious what section of the Analytics data are you looking at to make this determination? All of the pages I used to have were supposedly moved over to the blog then 301'ed. Was this really not done or were the pages not optimized properly?
**"(1) You've got a lot of duplicate pages on the site, e.g. **
http://www.shiftins.com/blog/7-sins-car-insurance-buyers-make/
http://www.shiftins.com/blog/7-sins-car-insurance-buyers-make/www.shiftins.com(See how the domain name is appended at the end of the second URL?) The later is redirected to the former, but it means you’ve got crawlers wasting a lot of time trying to index duplicate content and you're diluting your SEO equity. Of 269 pages, 267 are redirected duplicates. "
Are all of these duplicate pages coming from the blog? How can I identify these?
**Your bounce rates, time on site, page views and conversions all appear to have improved since the new site was deployed. That's great! **
Thank you that was the idea behind the redesign. Now I just need the traffic back!
**If you want the list of queries that were driving impressions before the conversion (and now aren't), email me (so I get your email) and I'll pass them along. **
I would greatly appreciate the list. Please email me at "greasy(at)gmail.com"
-
Okay. I see a few things.
The vast majority of the lost traffic is from local (LA, San Fran & San Diego) locations. People searching for "car insurance", "cheapest car insurance", "cheapest car insurance California" and other similar keyword phrases. You no longer have a page on your site optimized for those terms so you're not showing up in search results.
It looks like you might have auto as a menu choice under "insurance items", but...
(1) It's hidden behind your site logo when the drop-down menu appears so visitors and search engine spiders can't get to it. It IS indexed. (I see it in your sitemap and when I do a site command.)
(2) On your old site, the home page was optimized for "Cheap Car Insurance in California". Now you're tending to use the term "auto" more than "car" and you're also not using the word "cheap" and "cheapest".
Two other observations: duplicate content and drive-to-learn 404.
(1) You've got a lot of duplicate pages on the site, e.g.
http://www.shiftins.com/blog/7-sins-car-insurance-buyers-make/
http://www.shiftins.com/blog/7-sins-car-insurance-buyers-make/www.shiftins.com(See how the domain name is appended at the end of the second URL?) The later is redirected to the former, but it means you’ve got crawlers wasting a lot of time trying to index duplicate content and you're diluting your SEO equity. Of 269 pages, 267 are redirected duplicates.
(2) The drive-to-learn scholarship page is driving a lot of good traffic. But there appears to be a missing page (below). Visits to the 404 page stopped around the 19th, so you may have fixed this already.
/404.html?page=/content/insurance-program-application.aspx&from=http://www.shiftins.com/drive_to_learn_scholarship
I suggest trying to fix these things to see if it makes a difference. I also highly recommend the other item we talked about - indexing and optimizing the blog.
Your bounce rates, time on site, page views and conversions all appear to have improved since the new site was deployed. That's great!
If you want the list of queries that were driving impressions before the conversion (and now aren't), email me (so I get your email) and I'll pass them along.
-
I've identified it as only affecting organic search traffic, direct and referral were largely unaffected. I do not mind giving you read only access. What email should I grant access too?
-
You're right. It wouldn't. Just the analytics.
Updating the title tags isn't the issue cause it looks like they didn't have unique title tags before the transition. But it should help boost organic traffic.
You may be right (it's a lot of small things). Have you looked at your traffic sources before and after to see if anything stands out? Is the drop evenly spread across direct, organic, PPC and referred traffic? Is it primarily in one area?
I'd be happy to take a look if you want to give me temporary access to your analytics and WMT. Sometimes it just takes a fresh pair of eyes.
-
If don't have the analytics code set up on the blog pages, why would that affect my GWMT data?
Both GWMT and Analytics show a decline on the relaunch date. Would updating the title tags be the issue? Even without unique tags would it justify the huge drop?
I have a feeling it's a bunch of small things contributing to the drop in traffic and need help identifying the underlying cause of the decline. Thanks for your input.
-
No. That's not the sole cause b/c I can still see blog content indexed on Google. It looks like you currently don't have Google Analytics tracking codes setup on the blog content, so any visits you are getting aren't getting captured in reports.
Also on the old site, you had two separate sets of Google Analytics tracking codes set up on the blog content (UA-743349-4 and UA-30229507-1). It's possible the code was firing twice causing double counting.
-
Donna,
THE SITEMAP.... What great analysis! This could definitely be the problem. Thank you. Thank you. Thank you.
The company I'm currently working with created a separate sitemap for the blog than the main site but it does not look like they submitted it to WMT...
Would having two sitemaps but only submitting one to WMT cause the traffic to drop like this and not return?
-
Sorry it's taken me so long to get back to you. I would be more than happy to do that. In order to at the very most out of a crawl I would need access to Google Analytics. Just for the time of crawl.
What I'm going to do this combined wit what I'm going to do his combined SEM rush with deepcrawl.
I obviously will not charge you for this. let me look up how many pages your website days prior to confirming I will send you a private message and emailed or you can Google analytics once this is done you can delete it right away.
Would you do me a favor and use marketing.grader.com in order to show me approximately the size of your site.
I will and use SEM rush in addition because I think he may be ranking higher for keywords and use SEM rush in addition because I think you may be ranking higher for keywords that contain less traffic.
Another big thing that you have to think about did you use a link tool at your disposal Moz OSE, Ahrefs, Majestic & Google Webmaster tools so I can have deep crawl match up the back links with the new URLs? & tools/search console
in order to save yourself money and take it advantage of the Moz OSE, Ahrefs & Google Webmaster tools I strongly suggest that you sign up for a free trial using monitorbacklinks.com it comes with Ahrefs built in. You can add Moz , Majestic & GWT's via there API I can also upload any CSV file from any company like SEMRush exc.
I want to have the ability to she is much of the back link profile we will know so we're not missing something important.
Last but not least could you give me a rough idea of your web hosting set up? Would you mind running your website through. tools.pingdom.com
check your 301's using feedthebot.com (it redirects to a new domain but it is still the same tool set)
For Google Analytics tzickell (at) blueprintmarketing.com
-
I noticed a few problems. They might not be the answer you're looking for, but they could be a start.
- Do you have the same tracking code as before and on every page?
- Looks like your XML sitemap is missing some entries. It lists only 95 pages (none of the blog pages).
- None of the title tags on your blog are populated with unique entries.
- This has more to do with after people visit the site, but I noticed your main menu toolbar doesn't seem to be working correctly. It doesn't allow me to navigate from the home page to any of the insurance quote or customer service pages because the drop-down disappears when you navigate over it.
-
Are the new pages being indexed?
-
Thomas,
Thank you for your time! I seriously appreciate it. I've taken a quick look at the resources you provided and will be digging deeper into them soon. While the current company I'm working with looks like they did everything right by my standards, I'm starting to become worried because of all the online articles stating that I shouldn't lose more than 40% of traffic and that I should only have been affected for 3-4 weeks.
The first image I've attached is the organic search traffic data from my GA account showing the huge drop in traffic over the last two months.
The second image I've attached is the WMT data showing the drop in overall impressions and clicks on October 18th.
The third image is where it gets weird. It shows that the average overall ranking position has actually decreased showing that I'm actually ranking higher but getting less impressions and less clicks.
I'm having a hard time identifying where the issue is coming from. I've kept a pretty good record of data but can't seem to pinpoint what exactly the issue is. Is there anything that you can think of that I should look into? I would also appreciate any analysis, insights, or analytic tools you can provide.
traffic_zpsevs8mdcb.jpg impressions_zps0s1igziy.jpg position_zpsh6ipsvpx.jpg
-
Whenever your are Preparing for a Website Relaunch that involves change your URL structure abruptly you will have a dip however 90% seems extremely drastic
However this is very common in this photograph http://i.imgur.com/UtYUyCX.jpg
use this free tool from kapost to inventory your content https://app.kapost.com/auditor
I you not know what you did to prepare print for this side from 301 redirect which should be page for page using redirect match then slowly over time make sure everything is done properly http://i.imgur.com/lutF4aj.png
Read: https://moz.com/blog/web-site-migration-guide-tips-for-seos
- See: http://www.stateofdigital.com/40-deepcrawl-tweaks/
- https://www.clickz.com/clickz/column/2158206/-checklist-website-redesign-migration
- http://www.catalystsearchmarketing.com/9-seo-tips-successful-site-migration/
I like to move slowly and I always use Deep Crawl screaming frog is great too but in my opinion the DeepCrawl is the way to go.
- https://www.deepcrawl.com/knowledge/best-practice/what-you-need-to-prepare-for-a-website-relaunch/
- https://www.deepcrawl.com/knowledge/best-practice/test-development-changes/
- https://www.deepcrawl.com/knowledge/guides/comparing-a-test-website-to-a-live-website/
- https://www.deepcrawl.com/knowledge/tag/migration/
- https://builtvisible.com/deepcrawl-co-uk-crawler-choice-large-websites/
- http://www.lunametrics.com/blog/2013/04/29/big-content-site-migration-tips/
Because you mentioned WordPress and Drupal I would recommend reading these lunch checks prior to major modifications
- https://pantheon.io/docs/articles/wordpress/launch-check-wordpress-performance-and-configuration-analysis/
- https://pantheon.io/docs/articles/drupal/launch-check-drupal-performance-and-configuration-analysis/
remember Google is going to play it safe make sure you know why the traffic has disappeared. If you want I will write your site through one of my tools for you?
all the best,
Tom
sorry for all the references I can tell you that they have helped me a lot.
Preparing for a Website Relaunch
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Teaser Content Help!!
I'm in the process of a redesign and upgrade to Drupal 8 and have used Drupal's taxonomy feature to add a fairly large database of Points of Interest, Services etc. initially this was just for a Map/Filter for site users. The developer also wants to use teasers from these content types (such as a scenic vista description) as a way to display the content on relevant pages (such as the scenic vistas page, as well as other relevant pages). Along with the content it shows GPS coordinates and icons related to the description. In short, it looks cool, can be used in multiple relevant locations and creates a great UX. However, many of these teasers would basically be pieces of content from pages with a lot of SEO value, like descriptive paragraphs about scenic viewpoints from the scenic viewpoints page. Below is an example of how the descriptions of the scenic viewpoints would be displayed on the scenic viewpoints pages, as well as other potential relevant pages. HOW WILL THIS AFFECT THE SEO VALUE OF THE CONTENT?? Thanks in advance for any help, I can't find an answer anywhere. About 250 words worth of content about a scenic vista. There’s about 8 scenic vista descriptions like this from the scenic vistas page, so a good chunk of valuable content. There are numerous long form content pages like this that have descriptions and information about sites and points of interest that don't warrant having their own page. For more specific content with a dedicated page, I can just the the intro paragraph as a teaser and link to that specific page of content. Not sure what to do here.
Intermediate & Advanced SEO | | talltrees0 -
Domain Migration Hell!
5 weeks ago we migrated our site to a new domain. We also installed an SSL certificate on the new domain. The new domain was purchased 5 years ago but we only used it as a redirect address. It was more consistent with our brand so we decided to migrate to it. Great care was taken setting up page to page redirects. A formal domain change request was made to Google. In fact the move was implemented with only a handful of broken links on a 500 page site. Those links were quickly fixed. Our traffic declined from about 350 visitors a week to as low as 40 visitors the first full week after the move. Now the number of organic Google visits is up to 80, a drop of 75% !!! All except 20 (out of 500) pages are reindexed on Google Search Console. MOZ domain authority for the new domain has climbed from 5 to about 12. The old domain had a DA of 23. In Google Search Console hundreds of "URL Not Allowed" errors are the site map for our previous domain that redirects to our new domain. Attached please see image of this. The site map for the new domain appears normal, but about 160 pages are indexed that are not in the sitemap. I wonder if these two issues have somehow contributed to the drop in ranking. I have included images showing GCT for the 2 domains. I posted on MOZ a month ago and was told it just might take time. No improvement and now I am wonder if there is not some issue with the sitemaps causing havoc. Are traffic is down more than 80%. This does not seem normal. Any advice? Any suggestions as to how to expedite recovery? Thanks,
Intermediate & Advanced SEO | | Kingalan1
Alan0 -
Google cache is showing my UK homepage site instead of the US homepage and ranking the UK site in US
Hi There, When I check the cache of the US website (www.us.allsaints.com) Google returns the UK website. This is also reflected in the US Google Search Results when the UK site ranks for our brand name instead of the US site. The homepage has hreflang tags only on the homepage and the domains have been pointed correctly to the right territories via Google Webmaster Console.This has happened before in 26th July 2015 and was wondering if any had any idea why this is happening or if any one has experienced the same issueFDGjldR
Intermediate & Advanced SEO | | adzhass0 -
Migration Strategy
Hi guys, Just want to check on this site migration strategy. Basically we have an Australian based ecommerce site which is going to launch globally. The company has two site. One is (http://www.domainUS.com – for US market) and one is Australian based (http://www.domain.com.au). Basically the plan is to have one single global .com site (like ASOS.com) on a new domain which would be domain.com and put both the current http://www.domainUS.com (US VERSION) and http://www.domain.com.au (AUSTRALIAN VERSION) on the new domain: domain.com (global) To make it even more complicated the new global domain (domain.com) is in the process of being purchased (someone else has the domain) and won’t be available till January 2016. But the company wants to execute the new global setup in November 2015 temporary on the .com.au version The current migration plan is to create two different sub-folders one for US e.g. http:www.domain.com.au/us and one for AUD http://www.domain.com/au on the current domain Australian domain.com.au for the global launch in November 2015. Then once domain.com is ready in January 2016, then migrate to domain.com with the countries as sub-folder (as shown below in stage 3). I was wondering if you guys think this would be an ideal migration strategy given the circumstances. Link to screenshot of current migration strategy: http://c714091.r91.cf2.rackcdn.com/4c2aae21dcbd548f27d96840227b81bc6b8b00c592.png Any advice would be very much appreciated! Cheers, Chris
Intermediate & Advanced SEO | | jayoliverwright0 -
Large Site - Complete Site URL Change and How to Preserver Organic Rankings/Traffic
Hello Community, What is your experience with site redesign when it comes to preserving the traffic? If a large enterprise website has to go through a site-wide enhancement (resulting in change of all URLs and partial content), what do you expect from Organic rankings and traffic? I assume we will experience a period that Google needs to "re-orientate" itself with the new site, if so, do you have similar experience and tips on how to minimize the traffic loss? Thanks
Intermediate & Advanced SEO | | b.digi0 -
Lost 86% of traffic after moving old static site to WordPress
I hired a company to convert an old static website www.rawfoodexplained.com with about 1200 pages of content to WordPress. Four days after launch it lost almost 90% of traffic. It was getting over 60,000 uniques while nobody touched the site for several years. It’s been 21 days since the WordPress launch. I read a lot of stuff prior to moving it (including Moz's case study) and I was expecting to lose in short term 30% of traffic max… I don’t understand what is wrong. The internal link structure is the same, every url is 301 to the same url only without[dot]html (ie www.rawfoodexplained.com/science.html is 301′s to http://www.rawfoodexplained.com/science/ ), it’s added to Google Webmaster tool and Google indexed the new pages… Any ideas what could be possible wrong? I do understand the website is not optimized (meta descriptions etc, but it wasn't before either) .... Do you think putting back the old site would recover the traffic? I would appreciate any thoughts Thank you
Intermediate & Advanced SEO | | JakubH0 -
Severe health issues are found on your site. - Check site health (GWT)
Hi, We run a Magento website - When i log in to Google Webmaster Tools, I am getting this message: Severe health issues are found on your site. - <a class="GNHMM2RBFH">Check site health
Intermediate & Advanced SEO | | bjs2010
</a>Is robots.txt blocking important pages? Some important page is blocked by robots.txt. Now, this is the weird part - the page being blocked is the admin page of magento - under
www.domain.com/index.php/admin/etc..... Now, this message just wont go away - its been there for days now - so why does Google think this is an "important page"? It doesnt normally complain if you block other parts of the site ?? Any ideas? THanks0 -
Our quilting site was hit by Panda/Penguin...should we start a second "traffic" site?
I built a website for my wife who is a quilter called LearnHowToMakeQuilts.com. However, it has been hit by Panda or Penguin (I’m not quite sure) and am scared to tell her to go ahead and keep building the site up. She really wants to post on her blog on Learnhowtomakequilts.com, but I’m afraid it will be in vain for Google’s search engine. Yahoo and Bing still rank well. I don’t want her to produce good content that will never rank well if the whole site is penalized in some way. I’ve overly optimized in linking strongly to the keywords “how to make a quilt” for our main keyword, mainly to the home page and I think that is one of the main reasons we are incurring some kind of penalty. First main question: From looking at the attached Google Analytics image, does anyone know if it was Panda or Penguin that we were “hit” by? And, what can be done about it? (We originally wanted to build a nice content website, but were lured in by a get rich quick personality to rather make a “squeeze page” for the Home page and force all your people through that page to get to the really good content. Thus, our avenge time on site per person is terrible and Pages per Visit is low at: 1.2. We really want to try to improve it some day. She has a local business website, Customcarequilts.com that did not get hit. Second question: Should we start a second site rather than invest the time in trying to repair the damage from my bad link building and article marketing? We do need to keep the site up and running because it has her online quilting course for beginner quilters to learn how to quilt their first quilt. We host the videos through Amazon S3 and were selling at least one course every other day. But now that the Google drop has hit, we are lucky to sell one quilting course per month. So, if we start a second site we can use that to build as a big content site that we can use to introduce people to learnhowtomakequilts.com that has Martha’s quilting course. So, should we go ahead and start a new fresh site rather than to repair the damage done by my bad over optimizing? (We’ve already picked out a great website name that would work really well with her personal facebook page.) Or, here’s a second option, which is to use her local business website: customcarequilts.com. She created it in 2003 and has had it ever since. It is only PR 1. Would this be an option? Anyway I’m looking for guidance on whether we should pursue repairing the damage and whether we should start a second fresh site or use an existing site to create new content (for getting new quilters to eventually purchase her course). Brad & Martha Novacek rnUXcWd
Intermediate & Advanced SEO | | BradNovi0