Database Crash affecting our rankings
-
Here is one for you. We had a database crash, and was down for an hour and 15 minutes, on Dec 18th. During this time our system automatically sent out a 301 redirect to our product home page. (iboats.com/boat-parts-accessories/dm/)
On Dec 24th I noticed a huge ranking drop on a lot of our keywords, and some keywords that were serving up the redirect page from our database crash, in place of its normally ranked page.
So my assumption is that Google was crawling our site during the database crash and caching the redirect pages in place of our regularly ranked pages. So when a search query is made that would normally display our ranked page, it is now displaying the redirect page from the crawled cache.
And on other keywords where we normally would rank for, Google no longer has that page cached, so it drops it from ranking.
My question: Does this assumption sound accurate? If so, I'm assuming over time that our past ranked pages will show up once again after Google recrawls those pages and saves them in their cache.
I have several sites that were affected with this:
Thanks in advance for your input
-
Glad to hear you appear to be back on the right track
-
Update:
After unblocking Google, almost all of our rankings are back up, and in some cases a little improved. I was surprised how quickly Google recrawled and ranked the pages that dropped.
I did do a Fetch and submit on all my websites and pages. I'm not sure how Fetches are attended to by Google, but it appears they are.
I have an IT guy who doesn't feel a Fetch makes any difference. He says Google will crawl when they want to and probably does not pay attention to the Fetch request.
-
I wanted to get back to report the cause of our problem with a lot of our rankings dropping. We originally thought it was due to a database crash. And that still could be affecting some things.
We moved our servers to a new location. A couple of weeks ago, we switched over to some new IP addresses. When we did so, a program started blocking Google's IP addresses because they were hitting our servers with a lot of hits, and put those IP addresses on a blocked list. So our pages on some of the websites stopped getting crawled, and thus rankings dropped. We discovered the problem when exploring our Webmaster Tools Crawl Stats and noticed that the "kilobytes downloaded per day" had flat-lined. Doing a fetch on selected pages we could see that it was not fetching the page. So after unblocking those IP addresses, the pages got crawled, our crawl stats went back up, and our rankings started going back to where they were. We still have some rankings that have not bounced back, but assume they will as new crawls re-index those pages.
A lesson learned for me was to pay attention to the crawl stats. Any drastic variations could be a sign of a problem.
Brad
iboats.com -
I'm pretty sure that GWT is a little vague in terms of times that Googlebot visited with just the crawlrate shown on a day by day basis and there's some lag between now and when it happened. CPanel will show when spiders visited in latest visitors from memory, however I think that rather than looking back it would be better to simply ensure that this doesn't happen again with the 302 rather than the 301. Maybe refreshing of your sitemap submissions in GWT would help to get some crawling going on with a ping or two to get Googlebot back soon.
-
Also, can't we use GWT to find out the exact times or at least approximate times of when Google crawled a site? Or can we not find that information so precisely? In this case, it does seem that the 301 vs. 302 is the key problem, but also the fact that the system for getting rid of the 301 didn't work out properly.
-
It seems extreme that Google would react within an hour and 15 mins but who knows nowadays. Keep an eye on your GWT account and hopefully if you have a decent crawl rate things should remedy themselves. Stephen Salstrand made a good point. 302's rather than 301's should help. It's great to have something in place like a redirection for user experience in case of database failure, however, as Stephen said, it should be made clear to Google that it's only temporary.
-
Investigating it further, we have some permanent redirects that are still hanging. I've got my IT guys working on it as we speaking.
I've got to run, but I would like to revisit this soon. Once we have determined the problem, I will post it here.
Thanks for your opinions. They have helped.
-
Your assumptions are globally right. However, I have never seen Google react that quickly to a 301 redirect or even a crash, I always tell my customers "if you have a temporary issue with 404 and 500 erros, don't worry about it too much, Google won't react unless it is a permanent issue that lasts over three or four crawls".
This is why I would also investigate a penalty that just happened to take effect shortly after the crash. To rule that out, could you please tell us if some of your major keywords are still ranking well?
I don't think you sould worry too much about that, just wait a few days and see if some pages recover.
-
Good point on the 301's. I'll look into that.
Thanks, for your input!
-
I think your assumptions are on par. However, make sure to review that the 301 has been removed. Also, if you still want that auto redirect to happen on a crash, make it a 302 and not a 301 as a 301 will suck a lot of life out of your site (since SEs see it as permanent).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Finding the reason behind not Ranking-UP
Hello, I hope you guys are doing well. I published an article about 2 months ago and I tried to write a rich article in regards to SEO. Also, did a keywords research and found my competitors. I created a lengthy but meaningful article from all the competitors. Here is the link to my Article and my targeted keyword is "CSC Scholarship 2020". You can check my domain DA & PA also. It is higher than the websites' DA, PA who are ranked on the top of the page. My content is also Lengthy and Meaningful and to-the-point but still, my Article is not generating any result for me. I want that, please investigate the main issue that is causing this problem.
Technical SEO | | HansiAliya1 -
Does the domain extension effect domain authority and ranking
We have produces a website on a .company domain extension. We have produced a good sized website with unique content. However the DA remains at 1. There are no high priority issues in the page crawl. We suspect that the domain extension may be causing a lower DA. Is this a ranking factor?
Technical SEO | | easydomains0 -
Internal Link Rank Flow
I've read in many articles that pages can "pass" rank to other pages internally. Is anyone aware of any well done internal linking case studies which confirm this? If my homepage has the strongest Page Authority, would linking to another page deeper into my website from my homepage boost my rank for the deeper page in Google (more so than linking to the deep page from a page with lower page authority)?
Technical SEO | | poke10 -
Product listing adverts affect on organic
After reading there will be a drop down arrow on product listing adverts, which will push organic results down to display 16 products: http://searchengineland.com/google-testing-pla-expansion-to-show-16-product-listing-ads-166942?utm_source=twbutton&utm_medium=twitter&utm_campaign=tweet I wondered how badly this is going to affect anyone in organic e-commerce? is this going to be rolled out for every term and have a drop down arrow for each one? Is organic going to die with e-commerce now? Thoughts much appreciated.
Technical SEO | | pauledwards0 -
Whats happened to my rankings
Hey everyone, I hope someone might be able to help me figure out what has gone wrong here. I have a website which was slowly growing in rankings. The domain used was a .net However, It is a UK based business so I shifted this to a .co.uk domain and then followed googles advice in webmaster tools for moving address. ie, copy site, verify in GWMT and then 301 the old site. Now the .net had 71 indexed pages out of 73. But after 2 months .co.uk only has 41 out of 73 indexed. At the end of last week I did change the theme on my website although the content / urls have all remained the same. I have gone to check my rankings this morning and the site has totally bombed. Even the own brand name does not ranking in top 10 pages. I have not done an major link building at all yet for the site and any links that are there are all high quality from industry related authority sites. Looking at GWMT the latest links all look ok, nothing spammy but one thing I did notice is that it shows the .net domain providing 193 links via 301and also individually a great deal of the links that point to .net but have shown in .co.uk What I would like to know if have I actually done something wrong? Should I just kill the 301 (i am loathed to do this as a few of the links to this took me a long time to get), after spending a great deal of money developing my site and just starting to see some nice progress in the natural rankings and google has gone and pulled the carpet from under me. I would understand if I was doing something wrong but I have made strenuous efforts to ensure the linking on this site is whiter that white. Oh, I have had no warnings in my messages at all. Thanks in advance for any advice.
Technical SEO | | easyrider20 -
Killing Page Rank flow
Another SEO has told a friend to nofollow certain internal links i.e. to their own website. There are no hard feelings but this sounds like nonsense to me. Firstly, I'm sure Matt Cutts said that the link juice will not be redistributed amongst the other links (can't find the post - does anyone have the URL or confirmation?). Secondly (and this is obvious) those pages which have links to other pages in the website will have no link juice to pass back, resulting in a lower "total sum" and the inability for that PR to flow back. In short it seems silly. Any thoughts would be interesting to hear.
Technical SEO | | IPROdigital0 -
Does HTTPS Affect Inbound Link Numbers?
Hi All, I'm dealing with an internal IT staff that is trying to change an entire site to run on HTTPS instead of HTTP. The way they want things configured, all links pointing to HTTP URLs would redirect to the HTTPS. I'm assuming this would adversely affect page rank/domain authority, etc... am I right there? Thanks, Ben
Technical SEO | | Ben_Alvord0 -
If microsoft (bing) owns yahoo, then why are the rankings different?
Same keywords, different positions of different companies. Aren't they using the same algo for their rankings?
Technical SEO | | adriandg0