Database Crash affecting our rankings
-
Here is one for you. We had a database crash, and was down for an hour and 15 minutes, on Dec 18th. During this time our system automatically sent out a 301 redirect to our product home page. (iboats.com/boat-parts-accessories/dm/)
On Dec 24th I noticed a huge ranking drop on a lot of our keywords, and some keywords that were serving up the redirect page from our database crash, in place of its normally ranked page.
So my assumption is that Google was crawling our site during the database crash and caching the redirect pages in place of our regularly ranked pages. So when a search query is made that would normally display our ranked page, it is now displaying the redirect page from the crawled cache.
And on other keywords where we normally would rank for, Google no longer has that page cached, so it drops it from ranking.
My question: Does this assumption sound accurate? If so, I'm assuming over time that our past ranked pages will show up once again after Google recrawls those pages and saves them in their cache.
I have several sites that were affected with this:
Thanks in advance for your input
-
Glad to hear you appear to be back on the right track
-
Update:
After unblocking Google, almost all of our rankings are back up, and in some cases a little improved. I was surprised how quickly Google recrawled and ranked the pages that dropped.
I did do a Fetch and submit on all my websites and pages. I'm not sure how Fetches are attended to by Google, but it appears they are.
I have an IT guy who doesn't feel a Fetch makes any difference. He says Google will crawl when they want to and probably does not pay attention to the Fetch request.
-
I wanted to get back to report the cause of our problem with a lot of our rankings dropping. We originally thought it was due to a database crash. And that still could be affecting some things.
We moved our servers to a new location. A couple of weeks ago, we switched over to some new IP addresses. When we did so, a program started blocking Google's IP addresses because they were hitting our servers with a lot of hits, and put those IP addresses on a blocked list. So our pages on some of the websites stopped getting crawled, and thus rankings dropped. We discovered the problem when exploring our Webmaster Tools Crawl Stats and noticed that the "kilobytes downloaded per day" had flat-lined. Doing a fetch on selected pages we could see that it was not fetching the page. So after unblocking those IP addresses, the pages got crawled, our crawl stats went back up, and our rankings started going back to where they were. We still have some rankings that have not bounced back, but assume they will as new crawls re-index those pages.
A lesson learned for me was to pay attention to the crawl stats. Any drastic variations could be a sign of a problem.
Brad
iboats.com -
I'm pretty sure that GWT is a little vague in terms of times that Googlebot visited with just the crawlrate shown on a day by day basis and there's some lag between now and when it happened. CPanel will show when spiders visited in latest visitors from memory, however I think that rather than looking back it would be better to simply ensure that this doesn't happen again with the 302 rather than the 301. Maybe refreshing of your sitemap submissions in GWT would help to get some crawling going on with a ping or two to get Googlebot back soon.
-
Also, can't we use GWT to find out the exact times or at least approximate times of when Google crawled a site? Or can we not find that information so precisely? In this case, it does seem that the 301 vs. 302 is the key problem, but also the fact that the system for getting rid of the 301 didn't work out properly.
-
It seems extreme that Google would react within an hour and 15 mins but who knows nowadays. Keep an eye on your GWT account and hopefully if you have a decent crawl rate things should remedy themselves. Stephen Salstrand made a good point. 302's rather than 301's should help. It's great to have something in place like a redirection for user experience in case of database failure, however, as Stephen said, it should be made clear to Google that it's only temporary.
-
Investigating it further, we have some permanent redirects that are still hanging. I've got my IT guys working on it as we speaking.
I've got to run, but I would like to revisit this soon. Once we have determined the problem, I will post it here.
Thanks for your opinions. They have helped.
-
Your assumptions are globally right. However, I have never seen Google react that quickly to a 301 redirect or even a crash, I always tell my customers "if you have a temporary issue with 404 and 500 erros, don't worry about it too much, Google won't react unless it is a permanent issue that lasts over three or four crawls".
This is why I would also investigate a penalty that just happened to take effect shortly after the crash. To rule that out, could you please tell us if some of your major keywords are still ranking well?
I don't think you sould worry too much about that, just wait a few days and see if some pages recover.
-
Good point on the 301's. I'll look into that.
Thanks, for your input!
-
I think your assumptions are on par. However, make sure to review that the 301 has been removed. Also, if you still want that auto redirect to happen on a crash, make it a 302 and not a 301 as a 301 will suck a lot of life out of your site (since SEs see it as permanent).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Suggestions Required to Improve Ranking
My website URL is: http://goo.gl/AiOgu1 Hello, Recently my websites revoked from manual link penalty, impressions in GWT increased from 3K to 9K within 2 months, but most of all keywords are ranking on the 3rd, 4th and 5th page. Please suggest me some onpage changes.
Technical SEO | | sandeep.clickdesk0 -
Wordpress versus html and google ranking
My current SEO has always recommended that I take my site to wordpress. I really don't want to move to wordpress. I don't like it... I just like writing code in raw html, css, and script. I feel like I have more control that way. Wordpress just seems like a platform for blogs (I have my blog in wordpress). My question is, do wordpress websites typically rank better? Is there benefit to moving to it?
Technical SEO | | CalicoKitty20000 -
Sudden decline in ranking
Hi SEO People, Rankings for one of my search keywords has declined over the last two weeks from place 2-4 down to 13-15 on Google NZ. It had sat at the place 2-4 level for months. Nothing has changed on any of the sites above/below ours, and nor have any changes been made to our site. All our other, similar, keyword rankings have either stayed unchanged or improved. Does anyone have any bright ideas?
Technical SEO | | chris.elevate0 -
Sudden Drop in Keyword Rankings
We launched http://www.manufacturedfun.com/ earlier this year and had been ranking 1 & 2 on Google SERPs for the keywords we optimized, but last week we experienced a sudden drop in rankings that pretty much took us off the radar. For instance, 'popcorn machines' went as far back as page 5 and 'popcorn poppers' dropped even further to page 9. We are currently working on fixing the numerous Duplicate Page Title and Duplicate Page Content errors identified by SEOmoz, but since we have had those for about 6 months and ranked well anyway, I wonder if there's something else that we are missing. Any insight you can offer will be sincerely appreciated. Thank you!
Technical SEO | | GRIP-SEO0 -
Why do rankings show differentley when checked from different computers
When I check for keyword rankings directly in Google or Bing, I find relatively high ratings. when my client checks at his location, he gets another ranking, much lower. What accounts for the difference?
Technical SEO | | TexasBebe0 -
If microsoft (bing) owns yahoo, then why are the rankings different?
Same keywords, different positions of different companies. Aren't they using the same algo for their rankings?
Technical SEO | | adriandg0 -
Website Ranking Issue
Hi, We have been performing our own onsite of offsite SEO along with external assistance and have ranked well over the years with minimal impact from Google updates. Howevr the last so called Panda update has affected us heavily pushing our main phrase 'web design melbourne' from 2nd to 7th where we have been for almost 2 months now on Google.com.au irrespective of onsite or offsite work. We have been trying to find signs of any onsite, IP, duplicate content, titles or other issues that may be holding us back to no avail. The only flag that Google webmaster tools is showing is a number of bad internal site links, which I think is a glitch with the CMS we are using. Even the SEO MOZ tool gives us a higher ranking compared to most competitors on page 1 of Google.com.au for our main phrase. The biggest difference between us and competitors is we chose to target an internal page specific to the topic rather than our homepage. With this sadi we have also reduced our keyword density and content quantity inline with the other sites homepages. Can anyone help shed some light on this? and perhaps something obvious that we have missed, or where we should be looking? Thanks.
Technical SEO | | paulsid0 -
Google rankings tanked....Now what?
We just experience a drop in Google rankings, some pretty harsh, across all of the keywords we have been ranking greater than 50. I’m a noob at SEO, but a technical noob so I started doing my home work. I’ve seen references to the “google dance” and “Honeymoon”, but this hit seems to have effected competitors too. Everyone seems re-ranked with several junk directories jumping up more than I think they should. Has anyone else seen this? Is this more Google algorithm adjustment or a natural settling based on our new SEO attempts? In either case, what should we do next? I know there is a holistic approach and everything is important however, we need bang for the buck at this point to before we start bleeding. One or two next steps? Our industry is residential cleaning and the site is www.bitabliss.com Here is a little history:
Technical SEO | | BitABliss
The site that’s been running for about 2 years. We initially put up a very basic “throw something up” site without much thought of SEO except for some basics and a long tail approach with a blog, FaceBook and Twitter. We launched an updated site on Feb 23. with new theme and this time some, “on page” work to better hit the basics. The site structure was kept the same and we added on some more localized content in hopes to take advantage of local searches. Also, enter SEOMoz to get us tracking things (Yay MOZ). Until yesterday, we had been doing pretty well in some of our target cites even with the more basic site. When we launched the new site focusing on page titles, descriptions and page content, and a few directory attempts. We started to see some incremental growth. It seemed to me that this kind of growth meant that we were doing the right things and doing a better job than some of the other sites. Any way, yesterday we got smacked down. This seems too harsh for a for the slow increases we have seen over the last month. Any thoughts you have would be great appreciated. Thanks! -Shawn1