Site Migration and Traffic Help!
-
Hi Moz,
I recently migrated my website with the help of an SEO company using 301 redirects. The reason for the move was to change our CMS from .aspx to Drupal/Wordpress. The homepage (www.shiftins.com) and the blog (www.shiftins.com/blog) were the only two pages that kept the same url. Everything else was redirected. It's been about two months since the redirects were completed and traffic has dropped off about 90%. I'm starting to worry that something was not done properly and my traffic may never return.
The process for the redirects seem correct when I checked the work the SEO company did. All pages were duplicated, redirected to individual pages, then the old pages were de-indexed. Are there any insights the community can provide? Please help!
-
-
_Just curious what section of the Analytics data are you looking at to make this determination? _
(1) I looked at GA reports, Audience > GEO > Location > United States > California.
(2) I looked at a download of GWMT impression data comparing 9/28 - 10/30 to 10/31 - 12/1 data, sorted by the calculated difference in impressions data.
(3) Then went back to GA, looked at landing pages and searched for "car".
All of the pages I used to have were supposedly moved over to the blog then 301'ed. Was this really not done or were the pages not optimized properly?
I don't know if all pages were moved and properly 301'd. I did see at least one error though. /automobile/car-insurance-program.aspx redirects to /drive_to_learn_scholarship, which obviously is not the correct URL.
Are all of these duplicate pages coming from the blog? How can I identify these?
The screaming frog scan that Thomas sent should help you identify them.
_If you want the list of queries that were driving impressions before the conversion (and now aren't), email me (so I get your email) and I'll pass them along. _
I've emailed you the file.
-
Hi Donna,
Thank you.
The report is something you can customize to be completely white labeled very easily in less than 10 minutes. The tool is https://www.deepcrawl.com it starts at a very reasonable rate $80 and is capable of so much.
I would recommend Deep Crawl to anyone there fantastic.
All the best,
Tom
-
Thanks for clarifying the point about duplicate hits.
-
Excellent summary Thomas. Is that custom or are you using a paid tool to generate that?
-
All done use the URL provided to go through every issue on your site. remember you can click on anything to see more there are thousands of problems you can look directly at and see a fix for.
IN the URL
You will see green arrows to click on you can also click on anything highlighted in red or if there is a word for a number member you can click on it and see a lot more than what you see in the very beginning.
You have a lot of broken links it also appears your canonical URL is non-www but you 301 redirect to www.
USE THIS URL TO SEE EVERYTHING:
UES THIS FOR A summary http://d.pr/f/bvxB
Sorry it took me so long
Tom
-
so far if you look at the Google analytics indexed URLs and site map URLs compared to the URis downloaded you should upload the site map I gave you in the last post screaming frog XML sitemap with a XML image sitemap will be a step in the right direction.
It is a larger photo
http://i.imgur.com/IIhIx7q.png
Tom
-
Here is a photo showing that deep crawl is hard at work.
I've also added this URL which has a zip file that contains all your URLs your screaming frog crawl review and the pages that contain Google analytics the pages that do not and what UA number is attached to the page. http://d.pr/f/1f1AL
I want to clear one thing up you cannot get duplicate hit's using Google analytics twice on one page as long as the UA numbers are different the only thing that will happen is your bounce rate will go down dramatically. ( I am talking about full JavaScript snippets) can have two UA's in the same snippet and be okay.
I started to crawl here is a bigger photo I will post it to you when I'm done I will look at the information I've sent you so far I think you will find it very valuable.
http://i.imgur.com/i0F739b.png
All the best,
Tom
-
"The vast majority of the lost traffic is from local (LA, San Fran & San Diego) locations. People searching for "car insurance", "cheapest car insurance", "cheapest car insurance California" and other similar keyword phrases. You no longer have a page on your site optimized for those terms so you're not showing up in search results. "
Just curious what section of the Analytics data are you looking at to make this determination? All of the pages I used to have were supposedly moved over to the blog then 301'ed. Was this really not done or were the pages not optimized properly?
**"(1) You've got a lot of duplicate pages on the site, e.g. **
http://www.shiftins.com/blog/7-sins-car-insurance-buyers-make/
http://www.shiftins.com/blog/7-sins-car-insurance-buyers-make/www.shiftins.com(See how the domain name is appended at the end of the second URL?) The later is redirected to the former, but it means you’ve got crawlers wasting a lot of time trying to index duplicate content and you're diluting your SEO equity. Of 269 pages, 267 are redirected duplicates. "
Are all of these duplicate pages coming from the blog? How can I identify these?
**Your bounce rates, time on site, page views and conversions all appear to have improved since the new site was deployed. That's great! **
Thank you that was the idea behind the redesign. Now I just need the traffic back!
**If you want the list of queries that were driving impressions before the conversion (and now aren't), email me (so I get your email) and I'll pass them along. **
I would greatly appreciate the list. Please email me at "greasy(at)gmail.com"
-
Okay. I see a few things.
The vast majority of the lost traffic is from local (LA, San Fran & San Diego) locations. People searching for "car insurance", "cheapest car insurance", "cheapest car insurance California" and other similar keyword phrases. You no longer have a page on your site optimized for those terms so you're not showing up in search results.
It looks like you might have auto as a menu choice under "insurance items", but...
(1) It's hidden behind your site logo when the drop-down menu appears so visitors and search engine spiders can't get to it. It IS indexed. (I see it in your sitemap and when I do a site command.)
(2) On your old site, the home page was optimized for "Cheap Car Insurance in California". Now you're tending to use the term "auto" more than "car" and you're also not using the word "cheap" and "cheapest".
Two other observations: duplicate content and drive-to-learn 404.
(1) You've got a lot of duplicate pages on the site, e.g.
http://www.shiftins.com/blog/7-sins-car-insurance-buyers-make/
http://www.shiftins.com/blog/7-sins-car-insurance-buyers-make/www.shiftins.com(See how the domain name is appended at the end of the second URL?) The later is redirected to the former, but it means you’ve got crawlers wasting a lot of time trying to index duplicate content and you're diluting your SEO equity. Of 269 pages, 267 are redirected duplicates.
(2) The drive-to-learn scholarship page is driving a lot of good traffic. But there appears to be a missing page (below). Visits to the 404 page stopped around the 19th, so you may have fixed this already.
/404.html?page=/content/insurance-program-application.aspx&from=http://www.shiftins.com/drive_to_learn_scholarship
I suggest trying to fix these things to see if it makes a difference. I also highly recommend the other item we talked about - indexing and optimizing the blog.
Your bounce rates, time on site, page views and conversions all appear to have improved since the new site was deployed. That's great!
If you want the list of queries that were driving impressions before the conversion (and now aren't), email me (so I get your email) and I'll pass them along.
-
I've identified it as only affecting organic search traffic, direct and referral were largely unaffected. I do not mind giving you read only access. What email should I grant access too?
-
You're right. It wouldn't. Just the analytics.
Updating the title tags isn't the issue cause it looks like they didn't have unique title tags before the transition. But it should help boost organic traffic.
You may be right (it's a lot of small things). Have you looked at your traffic sources before and after to see if anything stands out? Is the drop evenly spread across direct, organic, PPC and referred traffic? Is it primarily in one area?
I'd be happy to take a look if you want to give me temporary access to your analytics and WMT. Sometimes it just takes a fresh pair of eyes.
-
If don't have the analytics code set up on the blog pages, why would that affect my GWMT data?
Both GWMT and Analytics show a decline on the relaunch date. Would updating the title tags be the issue? Even without unique tags would it justify the huge drop?
I have a feeling it's a bunch of small things contributing to the drop in traffic and need help identifying the underlying cause of the decline. Thanks for your input.
-
No. That's not the sole cause b/c I can still see blog content indexed on Google. It looks like you currently don't have Google Analytics tracking codes setup on the blog content, so any visits you are getting aren't getting captured in reports.
Also on the old site, you had two separate sets of Google Analytics tracking codes set up on the blog content (UA-743349-4 and UA-30229507-1). It's possible the code was firing twice causing double counting.
-
Donna,
THE SITEMAP.... What great analysis! This could definitely be the problem. Thank you. Thank you. Thank you.
The company I'm currently working with created a separate sitemap for the blog than the main site but it does not look like they submitted it to WMT...
Would having two sitemaps but only submitting one to WMT cause the traffic to drop like this and not return?
-
Sorry it's taken me so long to get back to you. I would be more than happy to do that. In order to at the very most out of a crawl I would need access to Google Analytics. Just for the time of crawl.
What I'm going to do this combined wit what I'm going to do his combined SEM rush with deepcrawl.
I obviously will not charge you for this. let me look up how many pages your website days prior to confirming I will send you a private message and emailed or you can Google analytics once this is done you can delete it right away.
Would you do me a favor and use marketing.grader.com in order to show me approximately the size of your site.
I will and use SEM rush in addition because I think he may be ranking higher for keywords and use SEM rush in addition because I think you may be ranking higher for keywords that contain less traffic.
Another big thing that you have to think about did you use a link tool at your disposal Moz OSE, Ahrefs, Majestic & Google Webmaster tools so I can have deep crawl match up the back links with the new URLs? & tools/search console
in order to save yourself money and take it advantage of the Moz OSE, Ahrefs & Google Webmaster tools I strongly suggest that you sign up for a free trial using monitorbacklinks.com it comes with Ahrefs built in. You can add Moz , Majestic & GWT's via there API I can also upload any CSV file from any company like SEMRush exc.
I want to have the ability to she is much of the back link profile we will know so we're not missing something important.
Last but not least could you give me a rough idea of your web hosting set up? Would you mind running your website through. tools.pingdom.com
check your 301's using feedthebot.com (it redirects to a new domain but it is still the same tool set)
For Google Analytics tzickell (at) blueprintmarketing.com
-
I noticed a few problems. They might not be the answer you're looking for, but they could be a start.
- Do you have the same tracking code as before and on every page?
- Looks like your XML sitemap is missing some entries. It lists only 95 pages (none of the blog pages).
- None of the title tags on your blog are populated with unique entries.
- This has more to do with after people visit the site, but I noticed your main menu toolbar doesn't seem to be working correctly. It doesn't allow me to navigate from the home page to any of the insurance quote or customer service pages because the drop-down disappears when you navigate over it.
-
Are the new pages being indexed?
-
Thomas,
Thank you for your time! I seriously appreciate it. I've taken a quick look at the resources you provided and will be digging deeper into them soon. While the current company I'm working with looks like they did everything right by my standards, I'm starting to become worried because of all the online articles stating that I shouldn't lose more than 40% of traffic and that I should only have been affected for 3-4 weeks.
The first image I've attached is the organic search traffic data from my GA account showing the huge drop in traffic over the last two months.
The second image I've attached is the WMT data showing the drop in overall impressions and clicks on October 18th.
The third image is where it gets weird. It shows that the average overall ranking position has actually decreased showing that I'm actually ranking higher but getting less impressions and less clicks.
I'm having a hard time identifying where the issue is coming from. I've kept a pretty good record of data but can't seem to pinpoint what exactly the issue is. Is there anything that you can think of that I should look into? I would also appreciate any analysis, insights, or analytic tools you can provide.
traffic_zpsevs8mdcb.jpg impressions_zps0s1igziy.jpg position_zpsh6ipsvpx.jpg
-
Whenever your are Preparing for a Website Relaunch that involves change your URL structure abruptly you will have a dip however 90% seems extremely drastic
However this is very common in this photograph http://i.imgur.com/UtYUyCX.jpg
use this free tool from kapost to inventory your content https://app.kapost.com/auditor
I you not know what you did to prepare print for this side from 301 redirect which should be page for page using redirect match then slowly over time make sure everything is done properly http://i.imgur.com/lutF4aj.png
Read: https://moz.com/blog/web-site-migration-guide-tips-for-seos
- See: http://www.stateofdigital.com/40-deepcrawl-tweaks/
- https://www.clickz.com/clickz/column/2158206/-checklist-website-redesign-migration
- http://www.catalystsearchmarketing.com/9-seo-tips-successful-site-migration/
I like to move slowly and I always use Deep Crawl screaming frog is great too but in my opinion the DeepCrawl is the way to go.
- https://www.deepcrawl.com/knowledge/best-practice/what-you-need-to-prepare-for-a-website-relaunch/
- https://www.deepcrawl.com/knowledge/best-practice/test-development-changes/
- https://www.deepcrawl.com/knowledge/guides/comparing-a-test-website-to-a-live-website/
- https://www.deepcrawl.com/knowledge/tag/migration/
- https://builtvisible.com/deepcrawl-co-uk-crawler-choice-large-websites/
- http://www.lunametrics.com/blog/2013/04/29/big-content-site-migration-tips/
Because you mentioned WordPress and Drupal I would recommend reading these lunch checks prior to major modifications
- https://pantheon.io/docs/articles/wordpress/launch-check-wordpress-performance-and-configuration-analysis/
- https://pantheon.io/docs/articles/drupal/launch-check-drupal-performance-and-configuration-analysis/
remember Google is going to play it safe make sure you know why the traffic has disappeared. If you want I will write your site through one of my tools for you?
all the best,
Tom
sorry for all the references I can tell you that they have helped me a lot.
Preparing for a Website Relaunch
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to carry across/capture linkjuice during an SEO site migration
Hi there - I am planning out an SEO migration but this thought just occured to me: If the links into a site's previous URL went to the non-canonical version of the domain name - e.g. to: https://theguardian.com/uk and not the correct version of that URL, which is: https://www.theguardian.com/uk Then, if I do a redirect simply from the correct canonical version of the domain:
Intermediate & Advanced SEO | | McTaggart
https://www.theguardian.com/uk - rather than the versions of the domain that are being pointed to by backlinks - e.g. https://theguardian.com/uk - then the migration will not be carrying across all the linkjuice from the previous site. So how would you suggest dealing with this issue?0 -
Is there an issue with my site?
Been mostly hanging around top of page two for the last couple of years for “Liverpool Wedding photographer” although got myself on page 1 for “Liverpool photographer” I have split the title of the page to target these two keywords. I took the Liverpool photographer off the title to see if it was being detrimental to the “Liverpool wedding photographer” I didn’t see no increase in ranking so put it back as I get a bit of commercial work from it. Since last year I have got onto page 1 at least three times around position 5-6. Within a week or two I start sliding down again and end up back at top of page two. I could understand this slow push out if my competitors were busy SEO wise but from what I have seen they are not. There is a guy using the keywords in URL and calls himself “Liverpool wedding photographer” last time I checked he literally had no links but is in the first 5 positions. I have I think a better link profile than every one else. Although I am on and off with Facebook and Instagram, (more off) so that probably isn’t helping. Although I have a colleague in the video side of things and he doesn’t use social media at all and it hasn’t harmed him. A few years ago I was burned quite badly by a total charlatan. He sunk my home page to page 4. He talked the talk about creating landing pages but his methods were shoddy to say the least. I can’t believe I was taken in by him, although I was only with him for 2 months. He was still using spammy link techniques to generate lots of toxic links for me! I disavowed all of his links and put the keywords back on the home page and was back to my usual top of page 2 position within a week. Since then I have disavowed all directory links and anything not wedding related. I have an article which ranks 1st or second for “Nikon CLS”. I have also another article of 2000 words or so on another reasonable placed photography website. A few links from other vendors or people I have taken photographs for. I have about 10 featured weddings with a link on 4 good weddings blogs. I don’t think a massive amount of blog comments although I have stopped doing this. If I look at most of the competitors these are their main links, with directories as well! Last winter I put a quite substantial article about documentary wedding photography on my home page. I flew to number 2, although I photographed The World Transformed (the alternative labour conference in Liverpool). I got a lot of clicks to a gallery page (few thousand off social media} so I don’t know if that coincided with it. Same thing – watching the website go down a few positions every day until within just over a week or two I was about 4<sup>th</sup> on page 2! Its like my website is on a spring which can push into page 1 but rebounds back to top of page 2. I am staring to worry that my site has been marked as a bad character in some way because I get what seems to be rough treatment from google compared to my peers. I have written I think 4 or 5 (1500 word) articles the last couple of months talking about lenses and wedding photography related topics and Google pushed me back to page 1, peaking At position 5. I was there for a few weeks and then the slide happened again. Bit demoralised at the moment, what to do? Any help or pointers would be most appreciated. Best wishes. David.
Intermediate & Advanced SEO | | WallerD0 -
How do we decide which pages to index/de-index? Help for a 250k page site
At Siftery (siftery.com) we have about 250k pages, most of them reflected in our sitemap. Though after submitting a sitemap we started seeing an increase in the number of pages Google indexed, in the past few weeks progress has slowed to a crawl at about 80k pages, and in fact has been coming down very marginally. Due to the nature of the site, a lot of the pages on the site likely look very similar to search engines. We've also broken down our sitemap into an index, so we know that most of the indexation problems are coming from a particular type of page (company profiles). Given these facts below, what do you recommend we do? Should we de-index all of the pages that are not being picked up by the Google index (and are therefore likely seen as low quality)? There seems to be a school of thought that de-indexing "thin" pages improves the ranking potential of the indexed pages. We have plans for enriching and differentiating the pages that are being picked up as thin (Moz itself picks them up as 'duplicate' pages even though they're not. Thanks for sharing your thoughts and experiences!
Intermediate & Advanced SEO | | ggiaco-siftery0 -
Site dropped after recovery
Hi everybody! I've been working for http://www.newyoubootcamp.com for some time now. They came to me as they had dropped heavily for their main term, "boot camp". This turned out to be due to a manual penalty, which was in part due to their forum being hacked, as well as some bad link building. Here's an example of the dodgy forum links - http://about1.typepad.com/blog/2014/04/tweetdeck-to-launch-as-html5-web-app-now-accepting-beta-testers.html. The anchor is "microsoft". They've all been 410'd now. Also, we cleaned up the other bad links as best we could, and got through the manual penalty. The site then returned to #5 for "boot camps", below its pre-crash peak of #2, but OK. Over the past few weeks, it has started to slide though. I'm certain it is not down to a lack of quality links - this site has great PR and links from national newspapers and magazines. There's been a few on-site issues too, but nothing outrageous. I'm getting a bit stumped though, and any fresh eyes would be much appreciated!
Intermediate & Advanced SEO | | Blink-SEO0 -
Clean URL help!
Hi all, In short, i'm looking to redirect examplepage.html to examplepage .I've got rid of the .html, sitewide this morning. However I want to redirect Google & people who have bookmarked the old url structure. Currently if you have the extension on or not, it will show in your browser. I'm wanting /examplepage.html to 301 redirect to /examplepage I've gone the normal way I'd do it by adding in .htaccess: Redirect 301 /examplepage.html http://www.example.com/examplepage I'm assuming it isn't redirecting as the example.html page is no longer... what is the way around this? Thanks for any help! In firefox the error of the page is: The page isn't redirecting properly Firefox has detected that the server is redirecting the request for this address in a way that will never complete.
Intermediate & Advanced SEO | | Whittie0 -
Google penalized site--307/302 redirect to new site-- Via intermediate link—New Site Ranking Gone..?
Hi, I have a site that google had placed a manual link penalty on, let’s call this our
Intermediate & Advanced SEO | | Robdob2013
company site. We tried and tried to get the penalty removed, and finally gave up and purchased another name. It was our understanding that we could safely use either a 302 or 307 temporary redirect in order to redirect people from our old domain to our new one.. We put this into place several months and everything seemed to be going along well. Several days ago I noticed that our root domain name had dropped for our selected keyword from position 9 to position 65. Upon looking into our GWT under “Links to Your site” , I have found many, many, many links which were pointed to our old google penalized domain name to our new root domain name each of this links had a sub heading “Via this intermediate link -> Our Old Domain Google Penalized Domain Name” In light of all of this going on, I have removed the 307/302 redirect, have brought the
old penalized site back which now consists of a basic “we’ve moved page” which is linked to our new site using a rel=’nofollow’ I am hoping that -1- Our new domain has probably not received a manual penalty and is most likely now
received some sort of algorithmic penalty, and that as these “intermediate links” will soon disappear because I’m no longer doing the 302/307 from the old sight to the new. Do you think this is the case now or that I now have a new manual penalty place on the new
domain name.. I would very much appreciate any comments and/or suggestions as to what I should or can do to get this fixed. I need to still keep the old domain name as this address has already been printed on business cards many, many years ago.. Also on a side note some of the sub pages of the new root domain are still ranking very
well, it’s only the root domain that is now racking awfully.. Thanks,0 -
Can a Hosting provider that also hosts adult content sites negatively affect our SEO rankings on a non-adult site hosted on same platform?
We're considering moving a site to a host that also offers hosting for adult websites. Can this have a negative affect on SEO, if our hosting company is in any way associated with adult websites?
Intermediate & Advanced SEO | | grapevinemktg0 -
My site is duplicated on the internet, please help.
I've been told that my site: "- your site is duplicated on the internet. Both www.joeyvalyphotography.com and joeyvalyphotography.com are valid internet addresses. This is a problem for SEO." I am wondering, what's the cause of this, and how it can fixed. Thanks In advanced, Joey
Intermediate & Advanced SEO | | gaji0