Increased 404 and Blocked URL Notifications in Webmaster Tools
-
In the last 45 days, I am receiving an increasing number of 404 alerts in Google Webmaster Tools.
When I audit the notifications, they are not "new" broken links, these are all links that have been pointing to non-existent pages for years that for some reason Google is just notifying me about them. This has also coincided with about a 30% drop in organic traffic from late April to early May.
The site is www.petersons.com and its been around for a while and the site attracts a fair amount of natural links so in the 2 years I've managed the campaign I've done very little link-building.
I'm in the process of setting up redirects for these urls but why is Google now notifying me of years old broken links and could that be one of the reasons for my drop in traffic.
My second issue is my I am being notified that I am blocking over 8,000 urls in my Robots file when I am not. I attached a screenshot.
Here is a link to a screenshot. http://i.imgur.com/ncoERgV.jpg
-
I doubt very much that an increase in old 404s resulted in a 30% organic traffic drop. I'd look closely at your backlink profile, competition and page quality to try and diagnose why you saw that drop in traffic.
As for the 404s I'd fix those that are fixable and 301 redirect the rest to relevant pages (or the home page). If the number is extremely large then you should put a high priority on fixing this. Otherwise I haven't met a site that Google couldn't find a 404 error on. And yeah, they keep telling you about the same ones!
Hope that helps!
Jacob
-
Hi!
As Lynn points out, there could be some issues in regards to your perceived uptime. Do you see a lot of 404 errors reported in Analytics as well? If this is the case, perhaps your hosting provider (or IT department) should have a look at this?
Also, adding the redirects seems like a good idea, as Google couold be reindexing some sites/pages linking to the old, deleted URL's.
Do you have a custom crawl frequency set up in Google Webmaster Tools? It's worth looking into if Googlebot is slowing down your site.
Good luck.Anders
-
The Moz scan is not showing the same errors. And we haven't made any technological changes. These are incoming links pointing to pages that don't exist anymore. It looks like its been that way for years, I just started getting notified of these and I'm wondering if somehow it is hurting the site.
About the robots file, I just don't know. I've decided to make it blank and re-assess in a few days.
-
Hi,
A bit difficult to say without some more details. Some of it might be outdated information. See: http://moz.com/blog/how-to-fix-crawl-errors-in-google-webmaster-tools for a rundown on how to check it if you haven't already. What urls is it flagging from the robots.txt? Are they still valid urls? In regards the 404s, 28,000 is quite a lot. Has your system changed or been updated recently? Maybe there is a systemic fault going on that is creating these errors? Is the moz scan flagging the same errors?
It is tough to say if the errors have any connection to the drop in visits, but it is certainly something you want to get to the bottom of. I threw your site into xenu (http://home.snafu.de/tilman/xenulink.html) and it was timing out on quite a few of the pages. Is it possible the site is timing out on heavy loads? That might account for the drop in organic visits also...
Lots of questions, not many answers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Sudden increase in backlinks with "Link Reclamation": Any risk from Google?
Hi all, We failed to redirect the links of our old website versions to new website pages for years and we are planning to now redirect all those old links to new in the process of link reclamation. This activity may increase the back links suddenly or steadily. If there is sudden increase in backlinks, will it hurts us? What's Google's stand? Thanks
Algorithm Updates | | vtmoz1 -
Placement of /p/ in URL structure for ecommerce site product URLs
Hi, We're a discussion about how to structure a clients ecommerce site product page URLs where 12345 represent the product SKU/number: https://domain.com/Item--i-12345 https://domain.com/product-name/p/12345 https://domain.com/p/12345 It's a toss up between the second and the third URL, but the SEO company is saying the third is best because of the placement with the /p/ and creating a silo for "products" that help search engines recognize it is a product. Does anyone have thoughts on this? Thanks!
Algorithm Updates | | AliMac260 -
Does Google Analytics Adjusted Bounce Rate Lead to Increase in Average Time per Visitor?
Hello, I just recently implemented adjusted bounce rate onto one of the websites that I track via google analytics. (http://searchenginewatch.com/article/2322974/How-to-Implement-Adjusted-Bounce-Rate-ABR-via-Google-Tag-Manager-Tutorial) Since doing so, obviously my bounce rate has gone down significantly, nearly half of what it use to be, but I've also noticed an increase in the average time per visitor. In fact, the increase of average time per visitor began the same day I adjusted the bounce rate. Has this happened to anyone else? Can someone please explain why/how this may occur?
Algorithm Updates | | WebServiceConsulting.com0 -
Keyword stuffing in URL? Ekk. Help Please.
Okay, so I work as content manager in the travel industry and we're re-doing our site, pretty much from scratch, including the SEO, anchor text/route url, etc. I am struggling with one particular thing. If all my url's have similar keywords, ie example.com/atlanta-trip and example.com/boston-trip and so on and so forth for every destination, will using "trip" in the url be seen by Google as keyword stuffing? Should I make my url's more diverse? My gut feeling is no based on all the Moz, Google and other SEO research I've done, because it's all relevant to the content and the user experience, but I'd like to be sure, since we really can't afford to get penalized by Google...again.
Algorithm Updates | | hpeisach0 -
Google indexing my website's Search Results pages. Should I block this?
After running the SEOmoz crawl test, i have a spreadsheet of 11,000 urls of which 6381 urls are search results pages from our website that have been indexed. I know I've read that /search should be blocked from the engines, but can't seem to find that information at this point. Does anyone have facts behind why they should be blocked? Or not blocked?
Algorithm Updates | | Jenny10 -
URL SEO
Hi All I am completely new to SEO and I have a question about URL's which I would like advise on. We are about to launch an immigration consultancy website which caters for several countries. For the example below we are targeting the keyword "UK Visit Visa", which URL would be better from an SEO prospective? 1. www.example.com/uk/visit-visa
Algorithm Updates | | Fuad_YK
2. www.example.com/uk/uk-visit-visa Thanks, Fuad0 -
Bing webmaster tools?
The majority of focus these days seems to be on Google. This leaves Bing to fall by the wayside, but I do understand why. Has anyone found any good reference material on Bing and why the amount of pages they index is substantially less than Google? while the sitemaps were submitted to Google and Bing around the same time, my client has ~165,000 / 202,000 pages indexed on Google and ~7,500 / 202,000 on Bing. Can anyone explain what's going on here or has no real research been done into the area?
Algorithm Updates | | linztm0 -
Website moving up and down SERPs alongside others in 'blocks'.
I have noticed that since the so-called 'Panda' updates my website has been moving up and down the Google SERPs in a kind of 'block' alongside other unrelated websites for certain keyword phrases. Whenever there is upwards or downwards movement it happens in tandem with the other websites in those blocks and it is very frustrating. Why is this and has anybody experienced anything similar? The website - http://bit.ly/jIFHpm The search engine - Google, US The keyword phrase - First phrase of website meta title Sorry for being so cryptic I just don't like openly giving out certain information - think it's a bad hangover from the Google Webmaster help forums where everything you post is indexed for Joe nobody to read at his leisure. If anybody would like to mention anything else related to any on or off-page factors on the website then your time would be much appreciated. One thing I am a bit concerned about, for example, is the repition of 'monitors' on the 'monitor shop' dropdown on the top navigation menu and also the sidebar. This would put a localised high density of the keyword in these navigation areas and I am slightly concerned about that. I have no malicious intent and it is appropriate for the user but perhaps the manufacturer names alone would suffice? Thanks in advance.
Algorithm Updates | | teebus0