Database Crash affecting our rankings
-
Here is one for you. We had a database crash, and was down for an hour and 15 minutes, on Dec 18th. During this time our system automatically sent out a 301 redirect to our product home page. (iboats.com/boat-parts-accessories/dm/)
On Dec 24th I noticed a huge ranking drop on a lot of our keywords, and some keywords that were serving up the redirect page from our database crash, in place of its normally ranked page.
So my assumption is that Google was crawling our site during the database crash and caching the redirect pages in place of our regularly ranked pages. So when a search query is made that would normally display our ranked page, it is now displaying the redirect page from the crawled cache.
And on other keywords where we normally would rank for, Google no longer has that page cached, so it drops it from ranking.
My question: Does this assumption sound accurate? If so, I'm assuming over time that our past ranked pages will show up once again after Google recrawls those pages and saves them in their cache.
I have several sites that were affected with this:
Thanks in advance for your input
-
Glad to hear you appear to be back on the right track
-
Update:
After unblocking Google, almost all of our rankings are back up, and in some cases a little improved. I was surprised how quickly Google recrawled and ranked the pages that dropped.
I did do a Fetch and submit on all my websites and pages. I'm not sure how Fetches are attended to by Google, but it appears they are.
I have an IT guy who doesn't feel a Fetch makes any difference. He says Google will crawl when they want to and probably does not pay attention to the Fetch request.
-
I wanted to get back to report the cause of our problem with a lot of our rankings dropping. We originally thought it was due to a database crash. And that still could be affecting some things.
We moved our servers to a new location. A couple of weeks ago, we switched over to some new IP addresses. When we did so, a program started blocking Google's IP addresses because they were hitting our servers with a lot of hits, and put those IP addresses on a blocked list. So our pages on some of the websites stopped getting crawled, and thus rankings dropped. We discovered the problem when exploring our Webmaster Tools Crawl Stats and noticed that the "kilobytes downloaded per day" had flat-lined. Doing a fetch on selected pages we could see that it was not fetching the page. So after unblocking those IP addresses, the pages got crawled, our crawl stats went back up, and our rankings started going back to where they were. We still have some rankings that have not bounced back, but assume they will as new crawls re-index those pages.
A lesson learned for me was to pay attention to the crawl stats. Any drastic variations could be a sign of a problem.
Brad
iboats.com -
I'm pretty sure that GWT is a little vague in terms of times that Googlebot visited with just the crawlrate shown on a day by day basis and there's some lag between now and when it happened. CPanel will show when spiders visited in latest visitors from memory, however I think that rather than looking back it would be better to simply ensure that this doesn't happen again with the 302 rather than the 301. Maybe refreshing of your sitemap submissions in GWT would help to get some crawling going on with a ping or two to get Googlebot back soon.
-
Also, can't we use GWT to find out the exact times or at least approximate times of when Google crawled a site? Or can we not find that information so precisely? In this case, it does seem that the 301 vs. 302 is the key problem, but also the fact that the system for getting rid of the 301 didn't work out properly.
-
It seems extreme that Google would react within an hour and 15 mins but who knows nowadays. Keep an eye on your GWT account and hopefully if you have a decent crawl rate things should remedy themselves. Stephen Salstrand made a good point. 302's rather than 301's should help. It's great to have something in place like a redirection for user experience in case of database failure, however, as Stephen said, it should be made clear to Google that it's only temporary.
-
Investigating it further, we have some permanent redirects that are still hanging. I've got my IT guys working on it as we speaking.
I've got to run, but I would like to revisit this soon. Once we have determined the problem, I will post it here.
Thanks for your opinions. They have helped.
-
Your assumptions are globally right. However, I have never seen Google react that quickly to a 301 redirect or even a crash, I always tell my customers "if you have a temporary issue with 404 and 500 erros, don't worry about it too much, Google won't react unless it is a permanent issue that lasts over three or four crawls".
This is why I would also investigate a penalty that just happened to take effect shortly after the crash. To rule that out, could you please tell us if some of your major keywords are still ranking well?
I don't think you sould worry too much about that, just wait a few days and see if some pages recover.
-
Good point on the 301's. I'll look into that.
Thanks, for your input!
-
I think your assumptions are on par. However, make sure to review that the 301 has been removed. Also, if you still want that auto redirect to happen on a crash, make it a 302 and not a 301 as a 301 will suck a lot of life out of your site (since SEs see it as permanent).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website ranking declined after connecting to CDN
Hi! We are trying to rank https://windowmart.ca for various local search terms. Our head office is in Edmonton where we try to rank https://windowmart.ca/edmonton-windows-doors/ for such terms as "windows Edmonton", "replacement windows Edmonton", "windows and doors Edmonton" as well as others. The website was the leader in its niche for around 2 years. Then we've got some server related issues, moved to a new server and connected CDN Nitropack that really improved our google speed test results. Recently we noticed that our rankings started to drop. Do you know if Nitropack can negatively effect local SEO rankings? Thank you!
Technical SEO | | vaskrupp0 -
Keyword ranking fluctuations
Hi For last month my website was ranking to 5 positions for this keyword (Magento Development Company). But recently (28-nov) it's out of 100, some time it's showing on 25 position but not showing in top 5 position. Here is my url (for analysis): https://magnetoitsolutions.com/services/magento-development/ Please explain why my keyword rankings are often not showing in the search listings. Note: There are some other keywords of different pages start getting ranking drop. please let me know is there anything i need to change. Thank
Technical SEO | | harrysamson0 -
Ranking not improving
Our site is now 3 months old (although the domain is older) but rankings don't seem to be improving at all. We've got some good quality relevant links coming into the site, and the content is unique and often updated. Is there something holding the site back? Am I being impatient? the site is www.help-my-mobility.org Thanks.
Technical SEO | | jj34340 -
Event Landing Pages not ranking
Hi there I need to optimize the website of a club/concert venue. The site isn't bad and has authority, but the event pages don't seem to rank and I'm unsure about the reason. There is an overview page of the events: http://www.kaufleuten.ch/events/ What happens currently when clicking on a specific event (on "WEITER", top right of each event) is that users get redirected to a hashtag page by jQuery. The href of "WEITER" itself links to another landing page (which is IMO the one we should see ranking for the specific event). Here is a concrete example: Look at the event "Tanz & Konzert: Andreas Vollenweider, Seven & ROKPA-KIDS" on /events by clicking on "WEITER", you get directed to http://www.kaufleuten.ch/events/#2790/andreas-vollenweider the actual "WEITER" link in the source code though, points to the landing page http://www.kaufleuten.ch/event/andreas-vollenweider/ This seems to be done by an AJAX load: jQuery loads a DIV with the ID "ajax-content". Apparently, this is the code responsible for it: $(„.link“, click(function() {
Technical SEO | | zeepartner
el.find('.wrapper').load(target+' #ajax-content', function() {
});
return false;
}); I know the site has good authority and should rank well. however, the event landing pages never seem to appear, but only the page /events is ranking: SERP
(Strangely, when using the site command, the event page suddenly appears above: SERP. (But I have never seen this in a "normal search query", even though we are the organisers and should at least be among the top 5). Now my question: Does Google consider this AJAX load to be some sort of cloaking? (because the href in the code is different to you actually end up by clicking "WEITER"). Will the landing pages begin to rank if we disable this AJAX load? Or should we stick to hashtags and not even create landing pages? (but then, we will have no control over title tags of specific events, right?) Thanks for your help, I'm a bit lost here as my JS knowledge is meagre... Cheers,
Phil0 -
Wrong page ranking even after fixes. Why?
Howdy, I've read a number of posts on this issue and followed all the advice I could find. My issue is this: several of our targeted keywords have the wrong page ranking which results in a loss of conversion and high bounce rate. I use the site:mydomain.com operator to see how the pages are ranking which I find really useful. One of our targeted keywords is 'wedding stationery' and the page which should rank is shop.confetti.co.uk/branch/wedding-stationery however this page ranks 3rd on our domain. I've done the following: Optimised the correct page De-optimised the ranking pages Added links from the incorrectly ranking page to the page I want to rank using keyword anchor text Added internal links to the page I want to rank from high Page Authority pages using keyword anchor text Here is a link to the SERP which shows the ranking for our domain for the 'wedding stationery' search term. I made the changes a couple of weeks ago. Any advice or explanations as to what is causing this would be greatly received. Thanks in advance, Brendan.
Technical SEO | | Confetti_Wedding0 -
How new Instant Pages Affect Analytics?
I am sure everyone around here is aware of Instant Pages that Google introduced at Inside Search Event. How does it affect Analytics? Since the page is pre-loading, does that get recorded as a visitor? If the user doesn’t click on the link, will that impact the bounce rate?
Technical SEO | | IM_Learner1 -
How will a domain change affect my rankings?
My company will undergo a domain change in the next few months. Other than implementing 301 redirects, what else can I do to help the search engines realize the site has moved? What kind of impact on rankings can I expect to see? Thanks in advance!
Technical SEO | | raylau0 -
One Keyword Rank Inexplicably Blasted Into Oblivion
Okay, so I'm working on my site, minding my own business and everything is just great. Many different terms on pages 1 -4, all inching ever upward. When suddenly, one term that got all the way to #11 gets blasted to oblivion... #75! Is there some kind of landmine one could step on that would cause that? All the other terms are fine.Nothing on the page changed since it first went up two months ago. Thanks!
Technical SEO | | 945011