100% sudden drop in traffic
-
Hi Guys
I've just had an awful fright as Google Analytics is saying my website http://www.clintonpower.com.au has dropped to nil traffic since the 14th September.
I've checked Google webmaster tools and all is OK with no malware or Google blacklisting that I can see.
Any ideas how I can find out what's happened? This is super scary because 99% of my business comes from Google.
I really have no idea what to do next or how to investigate the problem. Is there a way I can submit a query to Google through webmaster tools?
Thanks in advance!
Clinton
-
Thank you Gerd for your wonderful advice in this thread. This thread taught me a great deal and it's one of the reasons I love SEOMoz and the Q&A forum so much.
-
It's been a pleasure Clinton.
It will now be interesting to see if the non-working GA just was a false signal in traffic or if you still have other issues. Let us know - you should see changes within the next 1-2 days.
-
Thank you Gerd.
I uninstalled my GA plugins and reinstalled them.
GA is now saying I'm receiving data and there has been a slight increase in GA stats in the last day.
So you are correct that the 100% drop in traffic is due to broken GA code in site.
I really appreciate your time in responding to me and my problem.
-
The "Tracking Status" should say "Receiving data". Have a look at the attached image (and also this URL http://support.google.com/analytics/bin/answer.py?hl=en&answer=1008083).
Your plugin is using the traditional (old) GA snippet. The async snippet is the preferred option (been around for more than 2 years now) as it will track more accurately.
Just doing a code comparison, your plugin does not load the ga.js (notice in the image attached the missing document.write line?).
My suggestion would be to use your Analytics plugin and replace it with another one - "All in one SEO pack" or "Google Analytics for Wordpress" comes to mind.
This will sort out your tracking. Your SERPs are another (unrelated issue). Your drop in traffic you can verify if you look at your server access log. If there is absolutely no activity (or a sudden drop compared to previous month, then you have issues). I do suggest to run something like Webalizer/Awstats over your logs so that you at least can get an independent view on traffic.
-
Thanks Gerd. It looks like you are correct and it is not receiving data. It just says tracking installed- see screenshot.
I did find my subdomain www.clintonpower.com.au/consulting, which is a separate WP installation had a different tracking code, and I'm guessing it should be the same as the main domain. I have now corrected this.
Aside from analytics, SEOmoz is also saying 100% drop in traffic, but I'm unsure if SEOmoz is taking this from GA or their own crawl.
Thank you for clarifying the redirect and I do see the 156 pages indexed now.
-
Well, there are two problems: Your GA code does not work. If you turn on the console in Chrome you will see those errors. The broken GA code is the reason for no data feeding into GA. Also, whatever plugin you use to generate the GA code, it produces GA code which is wrong/outdated (see my earlier response regarding the GA async script).
The second problem is that when you guys ran a site:www.clintonpower.com.au, this is really wrong. It should be site:clintonpower.com.au - because:
- When you access www.clintonpower.com.au it does a 301 to clintonpower.com.au.
- Your sitemap content points to clintonpower.com.au and not www.clintonpower.com.au
I think you guys are looking at too many issues incorrectly. Fix the GA tracking first, because right now it does not track anything. You can check this in GA - Go to your GA profile and then select the Tracking Code tab - it should show in the middle of the page "Tracking Status: Receiving Data" - I would be surprised if it does show this.
With regards to indexing - your sitemap contains 63 URLs and Google has indexed 156 (site:clintonpower.com.au)
-
I use the Ultimate Google Analytics plugin, so there would be no change in the code because I don't add it manually.
-
Yes I think so Dana. I am using Ultimate Google Analytics plugin, so nothing has changed there.
-
OK. You're onto something Dana. That is not right because there should be many pages indexed. I have at least 30+ blog posts alone.
So I'm note sure what this means, which is one the search results you've pointed ou:t
User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Sitemap: http://clintonpower.com.au/sitemap.xml.gz
Ideas anyone?
[user-agent.png](http://clintonpower.com.au/consulting/wp-content/uploads/2012/09/user-agent.png)
-
The robots.txt is not the problem. The sudden drop in recorded traffic in GA is due to the script error.
I would have a very close look at GWMT - everything under health (crawl errors, crawl stats, index stats), traffic and optimization. Have a look if any errors started spiking. Also look at what your index ratio in your sitemap is - this should typically be around 60-80% (i.e. if your sitemap contains 100 URLs you should have at least 60 in the index).
The faulty GA code would not affect SERPs. Perhaps other changes caused temporary crawl errors (you will pick this hint up in GWMT).
I would fix the GA issue, then regenerate the sitemap and manually resubmit it via GWMT. Wait for 2-3 days (or until your content has been crawled).
With the GA being broken, you can only rely on your server access logs to determine if your organic traffic changed.
-
Gerd, for all of us less technical folks out here, can you explain why this was effecting the number of pages Clinton had indexed in Google SERPS?
-
Trust this suggestion, Clinton. Gerd is really smart and probably way more technically smart than me.
-
Your issue is that the analytics script throws Javascript errors i.e. "Uncaught ReferenceError: _gat is not defined"
Go into GA and the setup/admin function for your domain and then "Tracking Code" and then replace your current (old GA code) with the proper async analytics code.
-
The problem isn't the analytics code. The problem is the number of pages indexed in Google. I can say that, definitely.
[Updated] Many thanks to Gerd for his correct analysis of the problem. I stand corrected! I was looking at the wrong URL in site: I looked at site:http://www.clintonpower.com.au which only shows three results. Without the "www" yes shows 156 indexed pages.
I very much appreciate Gerd's expertise!
My apologies, Clinton for perhaps leading you to look at the wrong thing.
-
That was actually my first thought, so I went to site:http://www.clintonpower.com.au
According to the results I can see, there are only three results listed. I am assuming your site has way more than three pages?
One of the three results is a link that leads to this page:
User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Sitemap: http://clintonpower.com.au/sitemap.xml.gz
Hope we can all help you piece this together!
-
Thank you. That's worth checking out.
But I noticed this problem by just doing searches for my keywords. I noticed that I have dropped out of the SERPS and I was consistently on the first page for some of my keywords.
I'm aware of the duplicate page content issues for categories and tags.
For the moment, I'm unchecking nofollow and noindex for only the subpages and categories and seeing what happens.
-
Is it possible that the Analytics script was altered or removed? Wouldn't it at least be showing some direct traffic?
It's showing 156 pages indexed in Google and when I searched a couple of your page titles your site showed up at the top. I would monitor the search queries in WebmasterTools and see if anything looks different.
Be careful about indexing the category and tags archives since they can cause duplicate content... I learned the hard way
-
Yes, for starters uncheck all the boxes. Although I am unfamiliar with this specific platform, it sounds like a setting gone awry. The worst problems are often from the simplest mistakes.
After you uncheck all the boxes, spend a week monitoring your GWT reports. You'll know very quickly where there might be pages you don't want crawled or indexed, like dynamic search results pages on am e-commerce site.
It's great that you have a developer for help.
You might repost another Q & A question here regarding robots.txt for the specific platform you are using. You might very well find some specific help on which boxes to select and which boxes to leave unchecked.
I feel for you! I had a site disappear many many years ago because my host was in another company and sold his hosting company. I lost my entire business, so I really do understand that horrible feeling! I really hope something I've given you here helps. Cheers!
-
I've just looked in the Thesis site options and noticed that almost all the boxes under robots.txt for no follow and no index were turned on, except for a couple, such as subpages. Could it be related and should I just uncheck them all so everything is indexed and followed.
I'm not sure if this is the default setting because I've never edited the robots.txt settings.
-
That sounds very possible. It has to be something as simple as that to cause a radical 100% drop in traffic.
I've got my developer looking into it and will have some answers soon, I hope. I'll update you.
-
You are very welcome. Have someone look at your robots.txt file. It looks possible to me that you are disallowing your entire sitemap. If that's not it, my guess is it was a recent back end change. Can you uninstall Premise, undo anything else you've done in the last 10 days or so. Resubmit your sitemap and see if that fixes it. Then, one by one reinstall, or redo the changes you made, but wait a couple of days between each change.
I think something you have done is telling Google bot that you don't want your pages indexed.
-
Hi Dana
Not that I'm aware of, but that's at least something I can have checked out straight away.
I have installed Premise getting ready to sell a product. Not sure if that would conflict with those files.
Thank you!
-
Hi Clinton,
I'm not a super-technical SEO, but it looks like maybe you have something going on in your htaccess file or robots.tct file that is telling google not to include any pages from your site.
Have you changed anything in the backend settings recently?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How can I distinguish new visitors from existing (customers) in Google Analytics to attain an avg # of new visitor traffic per day/week?
i do marketing for a business software site where we have hundreds of clients and each account has on avg 100 users. I am having a very challenging time to attempting to figure out the real number of unique traffic that our site receives. **(what's creating the issue is that we have thousands of user accounts where our users log-in via our site to access our app/platform). Would love help with this! Christian
Reporting & Analytics | | Sundance_Kidd0 -
Drop in indexation but increase in organic traffic
We've had a puzzling drop in indexed pages on our ecommerce website. My crawl returns just over 25k items. Until 19/6 we had about 23-24k indexed. Then we experienced a sudden drop from 19/6 to 26/6: from 23,400 to 18,999, losing 4.4k pages from one week to the next. At the same time, our organic traffic has not decreased, it actually increased, however, it's only been a couple of weeks so that may be coincidence. A few things that have happened during the past few weeks: 31/5: we implemented pagination on category pages to avoid issues with duplicate content - could it be that this led to a decrease in indexed pages 3 weeks later? However, I can only find about 1.5k pages in my crawl that are page 2+ 18-19/6: we had some website outages over the weekend; as a B2B business, we don't get much traffic over the weekend, so I can't see an impact to traffic. However, the following week, indexation dropped by another 250 (then stayed the same this past week), so I don't think this was a factor. 21/6: we retired another website and migrated it to our main website. However, all pages were redirected to existing pages so no new pages were created for the migration. This doesn't really explain a decrease in indexation, but may account for some of the increase in organic traffic; however not all as the retired website hardly got any organic traffic. So, should we be worried? As our website is quite large, it would probably be quite difficult to pin point exactly which pages dropped off the index, but a loss of 19% of pages is quite significant. Then again, it doesn't appear to have negatively impacted organic traffic... Have you got any suggestions for what I should be looking at to find out what happened? Should I be worried at this point? I will definitely continue to have an eye on how our organic traffic (and indexation) develops but I am not sure if there is anything I can do at this point. I'd appreciate your advice on this, to make sure I am not missing something blindingly obvious. Thanks! RmWaNib JJm4tC3
Reporting & Analytics | | ViviCa10 -
Google Analytics unexplainable traffic spike
Viewing this report **Behaviour > Site content > All pages **with primary dimensions of **Page ** and **Page title **are showing different results for one specific page on our site. We noticed a huge spike in pageviews and entrances to that specific page on our site. The user flow report shows traffic going through and from the page (in high volume) from other pages on the site which suggests that it's not the usual case of spam referrals. When I view the report above by page, I get unrealistic data. Over 600% increase in pageviews and over 900% increase in entrances. When I view by page title however, I get realistic results. Can anyone help shed some light on why these two reports will be different? Anyone else seeing similar issues?
Reporting & Analytics | | OptiBacUK0 -
Organic Traffic Spike
I've been chipping away at the SEO for a client's site for about 6 weeks and a few days ago noticed a huge spike in organic traffic for about a dozen keywords. See attached. Previously traffic was around 20-30 unique new visitors a day. On the 17 it went up to 500+ for 1 day, now it's come back down again. This spike was not for 1 keyword but for about a dozen. I've never seen this before and wondered if anyone had experienced similar. The site is about 3 months old. ebix3rl
Reporting & Analytics | | deployseo0 -
Direct traffic decline
I've noticed a few of our sites (tour, hotel, and local attraction) which are very established and reasonably high brand recognition that have experienced a significant decrease in branded traffic (-20-30% compared to same period from the previous year) the past few months. There have been no changes in offline marketing though we are seeing a slight decrease in visitor arrivals (-5%) and higher hotel room rates. Is there a chance that Google's not set may be affecting direct traffic numbers? Any other thoughts on how we can figure out why brand traffic is dipping? Thanks
Reporting & Analytics | | SoulSurfer80 -
Hour of the day that my analytics goals are being triggered within the all traffic report.
I am trying to identify the hour of the day that particular keywords (organic and PPC) are triggering my goals. Ideally I'd like to be able to use the all traffic report with the secondary dimension set as keyword. Hopefully I'm missing something simple, thanks all. Mark
Reporting & Analytics | | mde9110 -
Getting Traffic for an Unranked Phrase
Over the last month, 40% of a client's search traffic as resulted from a phrase that they are not even ranking for in the top 100; nor are they popping up on PPC ads for it. How is this happening? I feel like I am missing something very obvious.
Reporting & Analytics | | ScriptiLabs0 -
Google News traffic spike mystery; referring URLs all blank, Omniture tags didn't fire.
Our content is occasionally featured in Google News. We recently have had two episodes where this happened, but (a) nearly all the referring URLs were blank, and (b) our backend logs show 3-4x more requests for the article in question than Omniture does. In other words, hundreds of thousands of visitors requested a URL from our site (as proven by the traffic logs), but don't seem to have come from Google News (because HTTP_REFERER was blank), and didn't execute the onpage javascript tag to notify Omniture of the pageview. Perhaps this has nothing to do with Google News, but it is too strong a coincidence that the two times we were on there recently, the same thing happened: big backend traffic spike that is not seen by Omniture. It is as if Google News causes browsers to pre-fetch our article without executing the javascript on the page. And without sending a referring URL. Has anyone else seen anything like this before? Stats from the recent episode:
Reporting & Analytics | | mcglynn
- 835,000 HTTP requests for the article URL (logged by our servers) - these requests came from 280,000 distinct IP addresses (70% US) - the #1 referring URL is blank. This accounts for 99.4% of requests. Which, in itself, is hard to believe. These people had to come from somewhere. I believe browsers don't pass HTTP_REFERER when you click from an SSL page to a non-SSL page, but I think Google News doesn't bounce users to SSL by default.That said, we do see other content pages with 70-90% blank referring URLs. Rarely 99+% though.0