Direct traffic is up 2100% (due to a bot/crawler I believe)
-
Hi,
The direct traffic to website www.webgain.dk has increased by over 2100% recently. I can see that most of it is from US (my target audience is in Denmark and the website is in danish).
What can I do about this? All this traffic gives my website a bounce rate of 99.91% for direct traffic. I believe it is some sort of bot/crawler. -
Already done. They also included the tip in their newsletter for beta-testers.
-
You might want to let them know about this, so they can add in documentation so future users know what is up before panicking.
-
Follow up: I have fixed this now. It was a monitoring tool by Digicure, where I have signed up to be a beta tester. Their platform checks the website like a normal visitor from servers around the world (in my test case it is Denmark and California) and thereby it looked like normal direct traffic in my data. I excluded their stated server IP-addresses in my Google Analytics filters and that helped. Thanks again guys for the help.
-
Thank you for all your great advice. I will follow them and see how it works.
-
If you are running Wordpress also check what page / pages are being accessed. I have had bots nail my wp-login like that before. If that is the case harden your installation, one thing I have found that stopped it was setting a deny in the htaccess on wp-login / wp-admin.
-
I was having the same problem ( for me it seemed to be Bings ads bot) . I used this guide below and it seems to filter out most of the bot visits.
-
I would check the service providers first just to know for sure they're all coming from the same provider. You can check this by visiting your Audience > Technology > Network report on the left side of your Google Analytics. If you see the same network and browsers being used I would use a filter (only if you're really determined/ 100% sure that it's bot traffic) to get them completely out of your Google Analytics view.
-
It's weird that the bot is accepting cookies, but with a bounce rate that high, I agree it's probably something automated (though it could be people who were looking for something else or were directed there by an email or an app accidentally). You can look through your logs to see IP addresses and then do as Atakala says and block the traffic if you're worried about bandwidth. You can also just filter it out in GA by excluding US traffic (if your'e worried about analytics being messed up).
-
It's probably AWS, which is amazon buyable crawl service.
If ıt costs you too much then try to ban it.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Traffic drop after hreflang tags added
We operate one company with two websites each serving a different location, one targeting EU customers and the other targeting US customers. thespacecollective.com (EU customers) thespacecollective.com/us/ (US customers) We have always had canonical tags in place, but we added the following hreflang tags two weeks ago (apparently this is best practice); EU site (thespacecollective.com) US site (thespacecollective.com/us/) Literally the same day we added the above hreflang tags our traffic dropped off a cliff (we have lost around 70-80% on the EU site, and after a minor recovery, 50% on the US site). Now, my first instinct is to remove the tags entirely and go back to just using canonical, but if this is truly best practice, that could do more damage than good. This is the only change that has been made in recent weeks regarding SEO. Is there something obvious that I am missing because it looks correct to me?
International SEO | | moon-boots0 -
Getting accurate Geo Location traffic stats in Google Analytics - HELP
One of our clients services the US and the UK, but having looked at the report over an extended period of time we can still see that the vast majority of traffic is coming from the US. I.e. our last report for March indicated that there were over 3,000 users in the US but only 6 in the UK. We know that Google Analytics works out a user’s location based on where their IP is located and not their physical location, and that this means that the data needs to be taken with a pinch of salt as it won’t always represent what you expect. That being said, we know that the traffic figures for Europe are largely inaccurate and would like to get some more accurate stats to report on. Is there a way to do so at all within Google Analytics?
International SEO | | Wagada1 -
International website sharing with .com/.au/.uk
I have a small business in the United States and would like to copy our main website for my international partners. My website is a .com. I think that their domains will end in their country codes: .au and .uk. We are open to using different domains. We plan to share blog articles and other content, but do not wish to be penalized for duplication. I have tried to read articles on this topic, but am unfamiliar with a lot of the terms. Is there any way to do this simply? Many thanks, Steph
International SEO | | essential_steph0 -
Why Google is not indexing each country/language subfolder on the ranks?
Hi folks, We use Magento 2 for the multi-country shops (its a multistore). The URL: www.avarcas.com The first days Google indexed the proper url in each country: avarcas.com/uk avarcas.com/de ... Some days later, all the countries are just indexing / (the root). I correctly set the subfolders in Webmaster tools. What's happening? Thanks
International SEO | | administratorwibee0 -
US traffic falsely inflating traffic figures and bounce rate.
Hi fellow Mozzers! We're handling the digital marketing for a UK-based franchise of a Canadian SaaS company, and I've noticed that a large proportion of their traffic has been coming from the US (not the majority, but enough to skew the figures). The Canadian arm of the business deals with the US market, but the majority, if not all, is direct traffic which seems to suggest they've seen the web address somewhere (not sure where though). Is there a search-friendly way to move this traffic back to the Canadian site? I know I can set up a filter for US traffic so it stops distorting the stats we're seeing (which I have now done), but my worry is this is causing a high bounce rate that may be impacting Google's perception of the site quality. The traffic has a 100% bounce rate (not surprisingly), so if we could find a best practice way of sending them to the Canadian site, that would be great. My first thought was a screen that appears for US traffic prompting them to the Canadian site, but presumably this would still count as a bounce as they're only on one page? Any help much appreciated! Cheers guys,
International SEO | | themegroup
Nick0 -
My local traffic has increased but USA traffic decreased..I dont know why!!
Hi Guys, A sticky one for ye. I have recently updated my site selling Jewelry in April of this year. Overall, Local Irish organic traffic has been stronger than ever in the first half of 2015. Yet in the USA, since March it's been at it's weakest for years, declining month-on-month. In terms of Organic Traffic for May & June, there's been a 30% increase in visitors from Ireland when compared to last year. Yet for the USA - the biggest market for us- there has been a 39% decrease this year over the same dates. It's the same for language demographics. Big decrease for en-US, but increases for en-IE and en-GB. It's not just the US. The site has taken a hit in Canada, Australia etc.So domestically the website looks to be performing better than ever before since the HTTPS switch, but it has taken a big hit internationally in our key market.We are targeting USA in search console, not changed any of the content in the site however he have added an SSL cert to make the whole site HTTPS like google said :)Any pointers are welcome
International SEO | | Johnny_AppleSeed0 -
Global SEO - How quickly/aggressively should one expand into multiple countries?
SITUATION: Our client is a global company lacking the global presence, so naturally the idea is performing international/global SEO in each country. For benchmarking purposes, our plan is to focus on a select number of keywords (ie 8-15) for each country and begin link building within each respective country. All SEO effort (ie. link building) will be for sub-folders (ie. www.client.com/subfolder/) on the same top level domain. Note, each country may have multiple languages, so each language will be broken out as it's own unique SEO campaign with it's very own strategy and link building efforts. For example: Mexico has 2 languages (English & Spanish) and will be considered 2 separate campaigns. PROBLEM: The client wants to be extremely aggressive and perform SEO on 3 new countries every month. This amounts to 36 new countries/SEO campaigns per year. Assuming each country has 2 languages each, we are looking at 6 SEO campaigns per month, or 72 per year. Our concern is that since all SEO effort will be performed on the same top level domain, we may be growing too fast and the search engines may consider the addition of these new pages and links to be too 'spammy'. We'd love to hear some feedback or personal experience on what might be considered a "safe" or "healthy" expansion into different countries. Thanks!
International SEO | | ByteLaunch0 -
How well does Google's crawlers understand foreign websites?
I speak 5 languages and therefore have the opportunity to do on-page SEO and content writing for 5 different cultures. This question to me has much to do with the way Google translator works. It doesn't, trust me! Which then makes me wonder how the web crawlers, which are designed with English in mind, can fairly and equally attribute the same ranking points to a foreign website. Since Google seems to use sematic search technology I'm wondering if foreign sites have it easier or not. Any ideas?
International SEO | | MassivePrime0