How do you find the source of a 404
-
I've recently noticed quite a sharp rise in the number of 404 errors on our site. Unsurprising really as we have just had a major upgrade of our site navigation. When looking in GA at the landing page stats the vast majority of them are from Google organic search. How do I find the source of the 404?
All help appreciated.
Thanks.
Jon
-
Try Open site explorer and "link opportunities" for any pages that are 404 and have external links. Webmaster tools will also show you pages that are 404 that have external links (though it doesn't show you the links) and Ahrefs has a similar tool
-
But that are only the internal sources...? Not?
-
For the quickness/effectiveness it would be, these in order:
1. Xenu
2. Screaming Frog
3. 404 Redirected Plugin (if you are using Wordpress)
Also once done also check with Google Webmaster tools and Moz tools to see if you caught all of them, this also takes a bit longer to update, thats why I listed it here, but you can also start with theses as well. If these campaigns/profiles are setup.
-
The Moz crawl will also identify 404s for you, and when you download the CSV, you can see the source of the 404.
-
http://www.screamingfrog.co.uk- is a great bit of software or Xenu
They are free and can tell you 404 etc. on your page and you can 301 from there.
-
Make sure you have google webmaster tools installed. On your dashboard, it will tell you if there are any crawl errors, click here to see where they are. Click on each link and it will give you the location of the URL and which pages are linking to it.
A quick solution would be to create 301 redirects for each page in your htaccess. However, it may be better in the long term to find all the pages linking to the missing pages and re-write them.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
404 vs 410 Across Search Engines
We are removing a large number of URLs permanently. We care about rankings for search engines other than Google such as Yahoo-Bing, who don't even list https status 410 code option: https://docs.microsoft.com/en-us/bingmaps/spatial-data-services/status-codes-and-error-handling Does anyone know how search engines other than Google handle 410 vs 404 status? For pages permanently being removed John Mueller at Google has stated "From our point of view, in the mid term/long term, a 404 is the same as a 410 for us. So in both of these cases, we drop those URLs from our index. We generally reduce crawling a little bit of those URLs so that we don’t spend too much time crawling things that we know don’t exist. The subtle difference here is that a 410 will sometimes fall out a little bit faster than a 404. But usually, we’re talking on the order of a couple days or so. So if you’re just removing content naturally, then that’s perfectly fine to use either one." Any information or thoughts? Thanks
Intermediate & Advanced SEO | | sb10300 -
Does MOZ Have a Tool to Find a Competitors Broken Links?
I would like to use MOZ to identify a competitors broken links. Does MOZ have such a tool? Where is it? My SEO consultant suggests that we have bloggers write contend and then link it to our site. I am concerned about the quality of the links that will be generated. He is confident that they will be of high quality and the process will be relatively quick and easy. My concern is future spam penalty or low quality links. Another consultant suggested replacing a competitors broken links. How effective is this? Is it more labor intensive than other link building techniques? Thanks,
Intermediate & Advanced SEO | | Kingalan1
Alan Rosinsky1 -
What to use instead of a 404
Hey there Mozzers, What would be preferable to use instead of a 404 on a ecommerce website. Can I use a 301 redirection to the main category of the product? So for example if I have a t-shirt that is not available anymore can I use a 301 to redirect the traffic to the clothing category?
Intermediate & Advanced SEO | | AngelosS0 -
404 Errors
Do 404 Errors really have a lot of impact on rankings and over all authority of the site with google? Say you have a site that all the pages have moved apart from the home page which is exactly the same before moving? So most of your pages are showing 404 errros.
Intermediate & Advanced SEO | | summer3000 -
How to fix Invalid Product Page registering as Soft 404
Somehow with our site architecture Google is crawling URLS for products we no longer carry (there are no links to those pages so I am still trying to figure out how Google is finding them).Those URLS are being redirected to our invalid product page. That invalid product page is returning a 200 OK code, but according to Google it should be a 404 so we get a soft 404 error. Google is seeing all of the URLs that redirect to that page as soft 404's as well. The first solution I can think of is to create a custom 404 page that looks just like our site, says we don't have the page/product they are looking for, has a search bar, sends a 404 code, etc. Is this the right way to go? And it will probably take some time to implement so is there a quick fix we could do first?
Intermediate & Advanced SEO | | ntsupply0 -
Should I remove 404 urls in webmaster tools?
I've recently removed a lot of category pages so should I remove the urls in webmaster tools or let them drop out of the index naturally?
Intermediate & Advanced SEO | | SamCUK0 -
Best way to find broken links on a large site?
I've tried using Xenu, but this is a bit time consuming because it only tells you if the link sin't found & doesn't tell you which pages link to the 404'd page. Webmaster tools seems a bit dated & unreliable. Several of the links it lists as broken aren't. Does anyone have any other suggestions for compiling a list of broken links on a large site>
Intermediate & Advanced SEO | | nicole.healthline1 -
301 or 404?
My client has a classified ads website with hundreds of thousands of classified ads. These ads expire quite fast. When the ad expires it gets removed. At the moment this results in a 404 page and thus hundreds of thousands of 404 erros in Webmasters Tools. From what I know this damages SERP results due to slow indexing of important sites and 404 being just plain bad SEO. I suggested doing a 301 from the expired ads to a upper category but this feels like cheating. The content hasn't actually moved, it has been removed. What would you suggest?
Intermediate & Advanced SEO | | PanuKuuluvainen0