Huge organic traffic drom after a perfect domain migration. What to do?
-
Hi,
I already asked the question on different places. But so far nobody could help me.
Hope someone can help me out. If possible.
I migrated my website https://vihara.nl to https://meditatieinstituut.nl and lost about 80% traffic (see printscreens). It's over more than a month ago now and there is no sign of getting it back up.Maybe there is nothing to do and
1. I have to be patient and traffic comes back in a few months.
or
2. There is nothing to do and I've lost everything I've build up in the last years. Start over again to get the rankings back.
or maybe, maybe
3. I just forgot something that I still need to do to get the rankings back up. Or there is something I did not think of...This is done:
- The website is migrated 1 on 1. No changes in content, url, code, etc. Everything is exactly the same as on the previous domain.
- 301 redirects whole domain (via htaccess a bulk redirect). All the old pages, without exceptions, lead to the exact new page.
- The new domain is running from CDN (Cloudflare) with the same settings as the previous domain.
- SSL is installed in the exact same way.
- Domain migration set up in Search console (working).
- Uploaded new sitemap (working).
- Updated internal links.
- Changed the most important external links (where I could get contact after reaching out)
- In meanwhile received some new external links and also posted new content
Anybody knows what to do? Or do I just have to be more patient and will it come back in a few months by itself?
Looking forward to suggetions.
Thanks!
Gerjan
Migratie-Meditatie-Instituut-2048x786.jpg verloop-sinds-de-start-2048x355.jpg
-
Hi Dennis
yes I was able to see everything inside Search Console’s It look to me like everything has been correctly. I am honestly kind of stumped as to why the 301ed domain shows more index links. The only thing I can think of is that the site map was submitted to Search Console and that the search and replace was recently done so those URLs were still on your hosted site.
Google will take up to 4 to 5 months make the move.it should be much quicker after you’ve done the search and replace on the URLs.
I would also upload the old XML site map to your new website & submit it to your Google Search Console.
I am happy to take a look at your Hosting Infrastructure and see if something is awry there I cannot find anything using quite a few different tool sets and looking at your Google Search Console. It seems to me that this should’ve been done much faster by Google.
I will bring it up to Googles John Mueller in a Twitter talk I am going to have with him next week.
all the best,
Tom
-
Thank you Thomas, I removed you and added you again. Did you receive the invite?
-
I **would still upload the old sitemap to the new domains website. **
can I ask you send me the search console Invite again?
** I can’t seem to find it & can’t get into GSC**
** TZickell@blueprintmarketing.com**
**you want a page to page 301 & you shoul only uSE on index if needed **
“the noindex rules in the pages are gone, since they are redirecting to the new domain. So maybe I need to delete the sitemap in the old domain? On the other hand, since al the pages are redirected and I also filled in the migration form in Search Console, it should not be a problem the sitemap is still there right?”See https://support.google.com/webmasters/answer/6033088?hl=en
- Sitemaps: Submit the two sitemaps you saved earlier from the mapping. Initially, the sitemap containing the new URLs would have zero pages indexed, while the sitemap of the old URLs would have many pages indexed. Over time the number of pages indexed from the old URLs sitemap would drop to zero with a corresponding increase of indexing of the new URLs.
I posted the translated URL
t_he URL_
https://meditatieinstituut.nl/domein-migratie-vihara-nl-naar-meditatieinstituut-nl/
Domain migration meditationinstitute.nl to meditationinstitute.nl
April 16, 2020 we have moved our entire website meditatieinstituut.nl to this domain, meditatieinstituut.nl.What have we done?
The website has been transferred one to one. No changes in content, url, technology, etc. Everything has remained the same.
301 redirects total domain (via htaccess bulk redirect). All old pages, without exceptions, end up on the exact same page.
The new domain runs from CDN (Cloudflare) with the same settings.
SSL is installed exactly the same way.
Domain migration in Search console set correctly.
New sitemap uploaded (and working).
Internal links updated.
The most important external links that I have influenced or have adjusted.
In the meantime already received some new external links and made some new content.The sad result in organic traffic, so far:
We dropped from nearly 300 visitors in one day to about 40 visitors.
And we had such a nice line since the beginning:
Now Google says in "Search Console Help" that you get a notification in Search Console for 180 days that your domain is being transferred. This may also indicate that it may take 180 days for all authority to continue. https://support.google.com/webmasters/answer/9370220?hl=en
“If critical pre-checks pass, all sites being migrated from or to will display a notification in Search Console that the move is in progress. You will see these notifications for 180 days. ”
The sequel
We hope to be able to quickly show a new print screen in which the traffic is back to the old level, from there a new upward trend.Since Google also indicated a long time ago that with a 301 redirect, 100% of the authority is now being forwarded, it is plausible that the entire authority will eventually also be forwarded.
If you notice something that we have forgotten in the migration process, or if you know something that could speed up the passing on of authority, please let us know!”
-
PS. I also resumed Cloudflare for the domain. Since it did not have any influence and it was paused about 2 weeks ago now.
-
Hi Thomas, just gave you access to GSC and sent you the mail below:It is really strange Google indexed even more of the old url’s. Really sharp from you, you noticed this. I did not see that myself.I was thinking, maybe this is because of the old domain in Search Console still contains the sitemap with al the url’s.But the noindex rules in the pages are gone, since they are redirecting to the new domain.So maybe I need to delete the sitemap in the old domain?On the other hand, since al the pages are redirected and I also filled in the migration form in Search Console, it should not be a problem the sitemap is still there right? This should make Google clear which pages are migrated so it can sent all the authority to the new domain and individual pages, right?I just gave you access to the Search Console for both the domain vihara.nl and meditatieinstituut.nl.Would be great if we can find an issue. But sadly I think everything is done right but it’s in the hands of Google now, and hopefully it will be better within the 180 days…On this page I've added some information about the migration progress. So when there are changes I will add this to this page. It's in Dutch but you can translate this.Thanks again for thinking with me.Gerjan
-
Hi Dennis,
thank you so much I really appreciate you giving me access to your search console I will give you an update in a couple of hours if that works?
I am starting to believe that it could be an HT Access file issue that should be the correct one for migrating domains
I can see you're now using cloud flare to redirect all of the possible domains I would recommend turning your back on for the main domain as well. You are correctly redirecting all your domains I checked with https://httpstatus.io/ you can see the results in the image below.
Large image https://i.imgur.com/6soPAEN.jpg
RewriteEngine on RewriteCond %{HTTP_HOST} ^oldsite.com [NC,OR] RewriteCond %{HTTP_HOST} ^www.oldsite.com [NC] RewriteRule ^(.*)$ https://newsite.com/$1 [L,R=301,NC]
RewriteEngine on RewriteCond %{HTTP_HOST} ^vihara.nl [NC,OR] RewriteCond %{HTTP_HOST} ^www.vihara.nl [NC] RewriteRule ^(.*)$ https://meditatieinstituut.nl/$1 [L,R=301,NC]
citing https://ahrefs.com/blog/301-redirects/
we can definitely push any of the old sites over with Cloudflare redirection system that I know works every time. I can tell from clicking on your URLs inside Google that they are redirecting but what's strange is that they have increased in the amount of URLs indexed since I last looked. Please look at my answer below or at this photo https://i.imgur.com/UZqSfHh.png
I will update you in 2 to 3 hours max giving you information on what I can figure out is doing this. I would recommend locking everything down with cloud flare even if you have had an issue with one of their IP's I'm sure will be gone by the time you turn it back on this way the HTTPS and www.
http://vihara.nl
https://vihara.nl
http://www.vihara.nl
https://www.vihara.nlthey must match
http://meditatieinstituut.nl
https://meditatieinstituut.nl
http://www.meditatieinstituut.nl
https://www.meditatieinstituut.nlessentially the four domains will all line up.
Because when I drop site:https://meditatieinstituut.nl" into Google I still get exactly 440 indexed URLs and the other domain has increased over 100 URLs in Google's index https://i.imgur.com/kdbrq7q.png
I look forward to updating you and I will look for your email.
Sincerely,
Tom
-
Hi Dennis,
I apologize it's taken me so long to get back to you
"Are you sure this is needed? The old sitemap contains the same url's, since the url's did not change. So I think it's not needed right?"
** I believe it is wise to put your old domains site map with your new domain because technically the URL did change because the domain changed**
"temporary paused Cloudflare"
** Thank you for explaining that you temporarily caused CloudFlare that makes a lot more sense to be frank with you I doubt that CloudFlare will hurt your site in any way shape or form even if it had a blacklisted IP address it's a reverse proxy so all the IP's are constantly changing. It might be that somebody did something negative with one of the four IP addresses that it signs to your website and I'm certain that CloudFlare would clean it up pretty quickly however it never hurts to remove another piece of technology and see if it's causing the problem.**
Yes, this is a little disturbing. I would expect that vihara.nl shouldn't be indexed anymore. The rankings are gone, but most pages are still indexed.
** It is an extremely clear sign that the site is not redirecting properly. They should no longer be in Google's index or Google should be made aware of this domain change one more time if you can do that?**
site:vihara.nl
** Bigger photo https://i.imgur.com/UZqSfHh.png**
It only contains these rules, to redirect every single page while only changing the domain:
#Options +FollowSymLinks
RewriteEngine on
RewriteRule ^(.*)$ https://meditatieinstituut.nl/$1 [R=301,L]** I believe that the issue with the redirects may come from the www. or www. still not redirecting. From what I can tell the HT Access file should be when I have placed in below you can check it here. https://ahrefs.com/blog/301-redirects/**
RewriteEngine on RewriteCond %{HTTP_HOST} ^vihara.nl [NC,OR] RewriteCond %{HTTP_HOST} ^www.vihara.nl [NC] RewriteRule ^(.*)$ https://_meditatieinstituut_.nl/$1 [L,R=301,NC]
_"Vimexx.nl > I don't think it's the best but it's quit good. It's the same as the previous site vihara.nl, so I expect it doesn't make it worse than it should be." _ **It does not have to be the best most expensive hosting just a quality web host. They are worth quite a bit when it comes to troubleshooting and configuration. In my experience maybe look for another one around the same price that it has better reviews? I apologize I don't know what "Vimexx.nl is referring to another domain that you own?**
Yes, I did a find and replace for vihara.nl to meditatieinstituut.nl. So even the images and everything are changed to the new domain.
Nice work that is very important.
** I think there is something missing that we are not able to put our fingers on I apologize I did not see this earlier and have not seen your search console or been able to index the domain. I will do that in the next couple of hours.**
**respectfully,** **Tom**
-
Thanks EGOL!
-
- Your current robots.txt file does not contain your new or old site map I found your new site map but I cannot find your old site map.
Are you sure this is needed? The old sitemap contains the same url's, since the url's did not change. So I think it's not needed right?
in addition, you are currently not using Cloudflare for using Apache which shows me the site is clearly not going through Cloudflare
I temporary paused Cloudflare to see if this might have a positive effect. Because I've read somewhere you can be on a Cloudflare IP that is blacklisted because some other site on the same IP did some blackhat work. But I think the change is very little and it's already a week ago and I don't see any effect after pausing it.
drop this into Google "site:https://meditatieinstituut.nl" 440 indexed URL
drop this into Google "site:https://vihara.nl" 406 indexed URLsYes, this is a little disturbing. I would expect that vihara.nl shouldn't be indexed anymore. The rankings are gone, but most pages are still indexed.
I would like to see your HTAccess code
It only contains these rules, to redirect every single page while only changing the domain:
#Options +FollowSymLinks
RewriteEngine on
RewriteRule ^(.*)$ https://meditatieinstituut.nl/$1 [R=301,L]I would like to know if you are working with a good hosting company
Vimexx.nl > I don't think it's the best but it's quit good. It's the same as the previous site vihara.nl, so I expect it doesn't make it worse than it should be.
as well as what you used to do a search and replace of your URLs?
Yes, I did a find and replace for vihara.nl to meditatieinstituut.nl. So even the images and everything are changed to the new domain.
you should also get your backlinks updated
Yes, I have done this with the most important links pointing to vihara.nl. Many of them are updated now. Some I did not receive a reply.
So thank you for your great reply! I'm really happy you took the time to lookup all the things that could help. Unfortunate I don't think there is something that can make a big change.
I hope that when vihara.nl gets less indexed, the authority goes to meditatieinstituut.nl. I really think it is somehow an authority problem. Everything seemed to be redirected and migrated instead of the authority, somehow... -
Thank you soo much Thomas. I just now see your reply (somehow I saw the notification my question was unanswered, while it wasn't.
I will check al your recommendations and come back to this. Also I will give you access to the search console. Will sent you a DM after I checked your suggestions.
-
Wow! Tom, that was a very generous and expert response.
Nice work!
-
I apologize I just spent approximately 60 minutes plus writing this out looking at the issues you have in my laptop was unplugged the battery died and I'm back to square one. What I will tell you is I can help me with this need to give me access to search console and allow crawlers your site.
Your current robots.txt file does not contain your new or old site map I found your new site map but I cannot find your old site map check it for a bad bite order mark or BOM
- https://www.deepcrawl.com/blog/best-practice/common-robots-txt-mistakes/
- https://www.distilled.net/resources/free-web-based-robotstxt-parser/
- https://opensource.googleblog.com/2019/07/googles-robotstxt-parser-is-now-open.html
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php## top site map should be old XML vihara
Sitemap: https://meditatieinstituut.nl/vihara-sitemap_index.xml
Sitemap: https://meditatieinstituut.nl/sitemap_index.xmlin addition, you are currently not using Cloudflare for using Apache which shows me the site is clearly not going through Cloudflare a reverse proxy which modifies the headers they would've been rewritten like this https://support.cloudflare.com/hc/en-us/articles/200170986-How-does-Cloudflare-handle-HTTP-Request-headers-
HTTP/1.1 200 OK
Date: Thu, 21 May 2020 12:25:15 GMT
Server: Apache/2
Vary: Accept-Encoding,Cookie,User-Agent
Upgrade: h2,h2c
Connection: Upgrade
Last-Modified: Thu, 21 May 2020 11:33:56 GMT
Accept-Ranges: none
Cache-Control: max-age=521, public, public
Expires: Thu, 21 May 2020 12:33:56 GMT
Referrer-Policy:
X-Pingback: https://meditatieinstituut.nl/xmlrpc.php
X-Powered-By: W3 Total Cache/0.13.3
Pragma: public
Content-Length: 137745
Content-Type: text/html; charset=UTF-8
- http://bseo.dev/WXRAtI
- http://bseo.dev/cM1gCX
- http://bseo.dev/iOr2qC
- http://bseo.dev/8XLDtp
- drop this into Google "site:https://meditatieinstituut.nl" 440 indexed URLs
- drop this into Google "site:https://vihara.nl" 406 indexed URLs
in addition, if you would like to set up the old domain to redirect to the new domain and none of the URLs or change just follow these simple instructions it will work like a one-to-one match I would like to see your HTAccess code
https://medium.com/@natterstefan/redirecting-one-domain-to-another-with-cloudflare-66bd1c88bfae
I would like to know if you are working with a good hosting company as well as what you used to do a search and replace of your URLs?
Check your URLs using WP CLI or better search and replace better yet do a complete check on both sides the migration could've happened perfectly using WP Migrate DB Pro because it now migrates themes images and files it is an expensive tool the best in the industry at what you're doing
https://deliciousbrains.com/wp-migrate-db-pro/
if you would be kind enough to send me screenshots of the configuration of your website or if you just want to speak with me click on my photo and give me a ring I am more than happy to tell you a lot more than I have time to write down for the second time here. I'm sorry that this is a very compact version of what I want to talk to about but it took me a long time to write out everything the first time and then of the power failed.
please look at URLs to them are PDFs to them are CSV's I would like to import your site into Pantheon, servebolt, Pagely or if you're looking to spend under $30 a month https://pressidium.com/
you should also get your backlinks updated with an outreach tool called https://pitchbox.com it is superb for link outreach and would help you site migrations.
sincerely,
Thomas
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unexplainable drop in traffic
Hello Mozzers, I am new at Moz and certainly hope you can help me!
Intermediate & Advanced SEO | | svsanchez75
I used to consider myself very knowledgeable in SEO since I had hundreds or maybe thousands of keywords very well ranked on Google Guatemala (www.google.com.gt) for more than a decade. That was until a year ago: November 8th, 2019... On that date, all of my rankings plummeted, never to return. At first I thought it was just a hickup from the Google Algorithm, but as days turned into weeks I became very worried, so I started doing a bunch of things: Reworked the pages (except home page) to make them responsive (I used to have two versions of each page, one for desktop and one for mobile). Removed the ads from the pages to make them faster, thinking it could be due to the speed (even if my competitors sites were slower!) Fixed thousands of 404s Disavowed thousands of bad domains and spammy URLs (I never bought a single link but there were thousands of links from forums, theglobe network, etc) Removed more than 12,000 members from my own forum who had never posted anything: about 4000 of them just had created a profile to include a link to different extenral sites. Fixed a few other technical aspects... Nothing helped. In fact, my rankings have kept going down. My content is good and unique, my site has good DA but still I get outranked and buried by several sites which don't have as much information as I have. There are NO manual actions against my site according to Search Console. As I mentioned before, I have never bought any backlinks, so all of my links should be natural (although there were thousands of links to my forum from spammy sites which I disavowed). So, I am frustrated as I really don't know what the problem is. I am giving you 3 examples of Keywords and URLs of pages that were number one for years, and now are not even on first page, so that you can see them and tell me your thoughts about what may be happening: KEYWORD: VOLCANES DE GUATEMALA
URL: https://www.deguate.com/geografia/volcanes/Los-volcanes-de-Guatemala.shtml Note: was #1, now is on 5th page. Removed all the ads to see if it would help. KEYWORD: MINISTERIOS DE GUATEMALA URL: https://www.deguate.com/artman/publish/politica_ministerios/Los-ministerios-de-Guatemala.shtml Note: was #1, now is on 2nd page. Removed all the ads to see if it would help. KEYWORD: LEYENDAS DE GUATEMALA URL: https://www.deguate.com/artman/publish/misterios-leyendas/las-leyendas-mas-famosas-en-guatemala.shtml Note: Was #1, now is on 3rd page. It's stuffed with ads, as it doesn't seem to matter wheter my pages have ads or not, and since I lost my rankings on thousands of pages at least I can probably generate a little more income like that. Thank you so much for the help you can provide!0 -
Tagged URL ranking organically
I've noticed that one of our GA tagged urls are ranking organically & therefore is skewing the referral data. The campaign that we were tracking is no longer active but the link still works, but it's going to an old landing page. I asked our developers if we could redirect it but they said that it didn't work. Does anyone have some advise or a solution for this? Thanks!
Intermediate & Advanced SEO | | Elihn0 -
SEO for a redirected domain name
Our client is a law firm with a name that is challenging to spell. We have procured a domain name for them that is catchy, easy to spell, and plays well into their brand, or at least the current campaign. We're using the campaign domain to direct traffic to their website with a 301 redirect. We have placed the campaign domain in a variety of offline mediums including print and outdoor. The client is currently in the number 1 spot for a good number of our highest priority keywords, so I do not want to do anything to jeopardize that. I'm also not sure this campaign will be their "brand" long-term so I don't want to risk making a switch and making it back. So for now, I'm most comfortable leaving the campaign domain as a redirect to their primary domain. Recently, the client approached me complaining (legitimately) that when people google the campaign domain, they are brought to search results for an entirely different domain because Google "corrects" the domain name for them. This is obviously a bad thing, with many users defaulting to entering urls into Google instead of the address bar. If you tell Google that it was wrong about the autocorrection, our site is in the number 1 position. I liken the situation to Overstock.com using O.co as their offline domain, but overstock.com as their online domain. But imagine if you googled o.co and google brought you to a list of results for "on.co" because it assumed you fat-fingered it. Is there anything I can do to prevent the domain name from getting corrected by Google?
Intermediate & Advanced SEO | | steverobinson0 -
Domain Issue
Starting a new local travel guide site. Would like to buy a domain and have found one with decent Domain Authority and Trust, but they want $2500 for the domain which I feel is a bit steep since I will be not using any of the content and it is generating hardly any revenue now. . I would rather not start from scratch with no links and no trust. I have a few questions.... -Any suggestions on sites to look for domains or strategy for finding and offering to buy? Any guidelines on how to value domains? If I but it and change registration do I risk losing all the value? Cold I just change technical contact info? Any other suggestions are welcome. Thanks.
Intermediate & Advanced SEO | | Reportcard0 -
Ugh...getting organized with my SEO
One thing I have learned about SEO is that it takes a patient, organized and task oriented person in order to be a good SEO'r. Luckily I have these skills which I think helps me with my own personal SEO, but at the same time I have other personality traits that work against me at the same time which can distract me from staying on track. I am a goal oriented person - I like to create weekly, monthly and yearly goals to help keep me focused. I am a patient person I am a task oriented person - I can repeat a task over and over again even if I hate it. I am very organized - I am a better house keeper than my wife (which drivers her crazy) but at the same time I have some other personality traits that work against me which counter act against my strong points. I can't leave a task undone and I have to complete it immediately I am a multi tasker - I can do 20 things at once. The struggle I have is even though I set goals, complete them and have the patience to do them at the same time I tend to work on things and won't move on until they are done. Even though their importance may not be as pressing an other areas. For instance I will work on getting rid of Google errors (404's), fixing code issues with the site people report instead of taking the time to work on the bigger things like fixing issues which effected me from Panda and Penguin. I get stuck on these smaller tasks since I know I can complete them faster, but they never seem to end. I would love to hear other models SEO'r use to help them organize their time management and spreading the tasks across the board and get everything done.
Intermediate & Advanced SEO | | cbielich0 -
Confusion about domain extension.
Hi, need bit suggestions from you guys. After researchi found a KW that have some good Lcoal search volume.. My question is should i buy the CLD as it has good LS volume or i should go for .com , .net etc. Becasue as i know that LS means that number of people searching form that location(based on IP) not number of people searching in that local version of google. So no need to go for CLD as it vl help only in local version.. Bit confused waiting for reply thanks
Intermediate & Advanced SEO | | Big_Zee0 -
Sudden drop in ranks and traffic after migrating community website into main domain
Hi, We recently moved our community website (around 50K web pages) to our main domain. It now resides as a sub-domain on our main website. e.g. Before - we had www.mainwebsite.com and www.communitywebsite.com After - we have www.communitywebsite.mainwebsite.com This change took place on July 19th. After a week, we saw 16% drop in organic traffic to mainwebsite.com. Our ranks on most of the head keywords including brand keywords have dropped. We had created 301 redirects from pages on www.communitywebsite.com before this change was made. Has anybody seen this kind of impact when domains are merged? Should we expect that within 3-4 weeks Google will be able to re-index and re-rank all the pages? Is there anything else we could do to rectify the situation? Any feedback/suggestions are welcome!
Intermediate & Advanced SEO | | Amjath0 -
Redirecting One Page of Content on Domain A to Domain B
Let's say I have a nice page of content on Domain A, which is a strong domain. That page has a nice number of links from other websites and ranks on the first page of the SERPs for some good keywords. However, I would like to move that single page of content to Domain B using a 301 redirect. Domain B is a slightly weaker domain, however, it has better assets to monetize the traffic that visits this page of content. I expect that the rankings might slip down a few places but I am hoping that I will at least keep some of the credit for the inbound links from other websites. Has anyone ever done this? Did it work as you expected? Did the content hold its rankings after being moved? Any advice or philosophical opinions on this? Thank you!
Intermediate & Advanced SEO | | EGOL2