undefined
Skip to content
Moz logo Menu open Menu close
  • Products
    • Moz Pro
    • Moz Pro Home
    • Moz Local
    • Moz Local Home
    • STAT
    • Moz API
    • Moz API Home
    • Compare SEO Products
    • Moz Data
  • Free SEO Tools
    • Domain Analysis
    • Keyword Explorer
    • Link Explorer
    • Competitive Research
    • MozBar
    • More Free SEO Tools
  • Learn SEO
    • Beginner's Guide to SEO
    • SEO Learning Center
    • Moz Academy
    • SEO Q&A
    • Webinars, Whitepapers, & Guides
  • Blog
  • Why Moz
    • Agency Solutions
    • Enterprise Solutions
    • Small Business Solutions
    • Case Studies
    • The Moz Story
    • New Releases
  • Log in
  • Log out
  • Products
    • Moz Pro

      Your all-in-one suite of SEO essentials.

    • Moz Local

      Raise your local SEO visibility with complete local SEO management.

    • STAT

      SERP tracking and analytics for enterprise SEO experts.

    • Moz API

      Power your SEO with our index of over 44 trillion links.

    • Compare SEO Products

      See which Moz SEO solution best meets your business needs.

    • Moz Data

      Power your SEO strategy & AI models with custom data solutions.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Free SEO Tools
    • Domain Analysis

      Get top competitive SEO metrics like DA, top pages and more.

    • Keyword Explorer

      Find traffic-driving keywords with our 1.25 billion+ keyword index.

    • Link Explorer

      Explore over 40 trillion links for powerful backlink data.

    • Competitive Research

      Uncover valuable insights on your organic search competitors.

    • MozBar

      See top SEO metrics for free as you browse the web.

    • More Free SEO Tools

      Explore all the free SEO tools Moz has to offer.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Learn SEO
    • Beginner's Guide to SEO

      The #1 most popular introduction to SEO, trusted by millions.

    • SEO Learning Center

      Broaden your knowledge with SEO resources for all skill levels.

    • On-Demand Webinars

      Learn modern SEO best practices from industry experts.

    • How-To Guides

      Step-by-step guides to search success from the authority on SEO.

    • Moz Academy

      Upskill and get certified with on-demand courses & certifications.

    • MozCon

      Save on Early Bird tickets and join us in London or New York City

    Unlock flexible pricing & new endpoints
    Moz API

    Unlock flexible pricing & new endpoints

    Find your plan
  • Blog
  • Why Moz
    • Small Business Solutions

      Uncover insights to make smarter marketing decisions in less time.

    • Agency Solutions

      Earn & keep valuable clients with unparalleled data & insights.

    • Enterprise Solutions

      Gain a competitive edge in the ever-changing world of search.

    • The Moz Story

      Moz was the first & remains the most trusted SEO company.

    • Case Studies

      Explore how Moz drives ROI with a proven track record of success.

    • New Releases

      Get the scoop on the latest and greatest from Moz.

    Surface actionable competitive intel
    New Feature

    Surface actionable competitive intel

    Learn More
  • Log in
    • Moz Pro
    • Moz Local
    • Moz Local Dashboard
    • Moz API
    • Moz API Dashboard
    • Moz Academy
  • Avatar
    • Moz Home
    • Notifications
    • Account & Billing
    • Manage Users
    • Community Profile
    • My Q&A
    • My Videos
    • Log Out

The Moz Q&A Forum

  • Forum
  • Questions
  • Users
  • Ask the Community

Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

  1. Home
  2. SEO Tactics
  3. Technical SEO
  4. Best strategy to handle over 100,000 404 errors.

Moz Q&A is closed.

After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

Best strategy to handle over 100,000 404 errors.

Technical SEO
3
8
1.2k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as question
Log in to reply
This topic has been deleted. Only users with question management privileges can see it.
  • SEO_Promenade
    SEO_Promenade last edited by Jul 24, 2014, 7:03 PM

    I recently been given a site that has over one-hundred thousand 404 error codes listed in Google Webmasters.

    It is really odd because according to Google Webmasters, the pages that are linking to these 404 pages are also pages that no longer exist (they are 404 pages themselves).

    These errors were a result of site migration that had occurred.

    Appreciate any input on how one might go about auditing and repairing large amounts of 404 errors.

    Thank you.

    1 Reply Last reply Reply Quote 0
    • KristinaKledzik
      KristinaKledzik @SEO_Promenade last edited by Aug 15, 2014, 2:50 PM Aug 15, 2014, 2:48 PM

      This is a pretty thorough outline of what you need to do: http://moz.com/blog/web-site-migration-guide-tips-for-seos

      My steps are usually:

      1. Identify pages that get significant organic traffic by pulling the Organic Traffic report in Google Analytics for the past year or so.
      2. Identify pages that have a significant number of links (or, have links from high traffic sources) in Open Site Explorer.
      3. Map where that content should be now, and 301 redirect to new pages.
      4. Completely remove all old pages from the index by 404ing them and making sure that no links on new pages point to old pages.

      Sounds quick and simple, but this definitely takes time. Good luck!

      1 Reply Last reply Reply Quote 1
      • SEO_Promenade
        SEO_Promenade last edited by Aug 15, 2014, 2:42 PM Aug 15, 2014, 2:42 PM

        Kristina - thanks for the feedback.

        By any chance, would you have a site migration guideline that you recommend?

        KristinaKledzik 1 Reply Last reply Aug 15, 2014, 2:48 PM Reply Quote 0
        • KristinaKledzik
          KristinaKledzik last edited by Aug 15, 2014, 2:41 PM Aug 15, 2014, 2:33 PM

          There really isn't a problem with having 100,000 404 "errors." Google's telling you that it thinks 100,000 pages exist, but when it tries to find them, it's getting a 404 code. That's fine: 404s tell Google that a page doesn't exist and to remove the page from Google's index. That's what we want.

          The real problem is with your site migration, as FCBM pointed out. If you properly 301 redirect old pages to new, Google will be redirected to the new page, it won't just hit a 404. If you fix the problems with the site migration (not focusing on Google too much), the 404 errors will naturally subside.

          The other option is to just take the hit from the migration, and Google will eventually remove all of these pages from its index and stop reporting on them, as long as there aren't live links pointing to the removed pages.

          Good luck!

          1 Reply Last reply Reply Quote 1
          • topic:timeago_earlier,14 days
          • SEO_Promenade
            SEO_Promenade last edited by Aug 1, 2014, 4:59 PM Aug 1, 2014, 4:59 PM

            It is a problem with the site migration.

            Never the less, I have a site right now with over 100,000 errors dealing with 404.

            I'm looking for a game plan on how to deal with this many 404 errors in a time effective way.

            Any ideas with type of tools or shortcuts? Has anyone else had to deal with a similar issue?

            1 Reply Last reply Reply Quote 0
            • topic:timeago_earlier,8 days
            • FCBM
              FCBM last edited by Jul 24, 2014, 8:21 PM Jul 24, 2014, 8:21 PM

              Here's one thought to start the quest. ID if the migration was done correctly.

              eg If you had a site that was example.com/mens did the 301 look like newsite.com/mens? If not then you might be having tons of issues with a bad planned migration.

              1 Reply Last reply Reply Quote 0
              • SEO_Promenade
                SEO_Promenade last edited by Jul 24, 2014, 8:10 PM Jul 24, 2014, 8:10 PM

                The WMT notion helps. Thank you.

                The main concern is really timing. Are there any effective ways of going through thousands of 404 pages and finding valuable redirects?

                1 Reply Last reply Reply Quote 0
                • FCBM
                  FCBM last edited by Jul 24, 2014, 7:55 PM Jul 24, 2014, 7:54 PM

                  404s are not founds which are fine if they are really not found and there isn't a different url to point the original page to. One big issue could be that during the migration the old pages weren't 301'd which would result in tons of 404s.

                  Go through the 404s and see if they are issues or just relics from old data. Then you can mark in fixed in WMTs.

                  Hope that helps

                  1 Reply Last reply Reply Quote 1
                  • 1 / 1
                  1 out of 8
                  • First post
                    1/8
                    Last post

                  Got a burning SEO question?

                  Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


                  Start my free trial


                  Browse Questions

                  Explore more categories

                  • Moz Tools

                    Chat with the community about the Moz tools.

                  • SEO Tactics

                    Discuss the SEO process with fellow marketers

                  • Community

                    Discuss industry events, jobs, and news!

                  • Digital Marketing

                    Chat about tactics outside of SEO

                  • Research & Trends

                    Dive into research and trends in the search industry.

                  • Support

                    Connect on product support and feature requests.

                  • See all categories

                  Related Questions

                  • sforoughi

                    disavow link more than 100,000 lines

                    disavow spam

                    I recieved a huge amount of spamy link (most of them has spam score 100) Currently my disavow link is arround 85.000 lines but at least i have 100.000 more domain which i should add them. All of them are domains and i don't have any backlink in my file. My Problem is that google dosen't accept disavow link which are more than 2MB and showes this message : File too big: Maximum file size is 100,000 lines and 2MB What should i do now?

                    Technical SEO | Nov 3, 2021, 5:04 AM | sforoughi
                    0
                  • WeAreDigital_BE

                    Subdomain 403 error

                    Hi Everyone, A crawler from our SEO tool detects a 403 error from a link from our main domain to a a couple of subdomains. However, these subdomains are perfect accessibly. What could be the problem? Is this error caused by the server, the crawlbot or something else? I would love to hear your thoughts.
                    Jens

                    Technical SEO | Nov 19, 2018, 2:09 PM | WeAreDigital_BE
                    0
                  • MichaelGregory

                    Hundreds of 404 errors are showing up for pages that never existed

                    For our site, Google is suddenly reporting hundreds of 404 errors, but the pages they are reporting never existed. The links Google shows are clearly spam style,  but the website hasn't been hacked. This happened a few weeks ago, and after a couple days they disappeared from WMT. What's the deal? Screen-Shot-2016-02-29-at-9.35.18-AM.png

                    Technical SEO | Mar 1, 2016, 2:45 PM | MichaelGregory
                    0
                  • Happy-SEO

                    :443 - 404 error

                    I get strange :443 errors in my 404 monitor on Wordpress https://www.compleetverkleed.nl:443/hoed-al-capone-panter-8713647758068-2/
                    https://www.compleetverkleed.nl:443/cart/www.compleetverkleed.nl/feestkleding
                    https://www.compleetverkleed.nl:443/maskers/ I have no idea where these come from :S

                    Technical SEO | May 19, 2015, 6:04 PM | Happy-SEO
                    2
                  • TIM_DOTCOM

                    Handling of Duplicate Content

                    I just recently signed and joined the moz.com system. During the initial report for our web site it shows we have lots of duplicate content. The web site is real estate based and we are loading IDX listings from other brokerages into our site. If though these listings look alike, they are not. Each has their own photos, description and addresses. So why are they appear as duplicates – I would assume that they are all too closely related. Lots for Sale primarily – and it looks like lazy agents have 4 or 5 lots and input the description the same. Unfortunately for us, part of the IDX agreement is that you cannot pick and choose which listings to load and you cannot change the content. You are either all in or you cannot use the system. How should one manage duplicate content like this? Or should we ignore it? Out of 1500+ listings on our web site it shows 40 of them are duplicates.

                    Technical SEO | Apr 26, 2015, 10:21 PM | TIM_DOTCOM
                    0
                  • Pete4

                    Why is Google Webmaster Tools showing 404 Page Not Found Errors for web pages that don't have anything to do with my site?

                    I am currently working on a small site with approx 50 web pages.  In the crawl error section in WMT Google has highlighted over 10,000 page not found errors for pages that have nothing to do with my site.  Anyone come across this before?

                    Technical SEO | Feb 10, 2015, 1:44 PM | Pete4
                    0
                  • mtthompsons

                    Backlinks that we have if they are 404?

                    Hi All, Backlinks that we have if they are 404? Open site explorer shows 1,000 of links and when I check many are 404 and those are spammy links which we had but now the sites are 404 I am doing a link profile check which is cleaning up all spammy links Should i take any action on them? As open site explorer or Google still shows these links on the searches. Should we mention these URL's in disallow in Google webmaster. Thanks

                    Technical SEO | Jul 28, 2013, 11:57 PM | mtthompsons
                    0
                  • MarloSchneider

                    How to find links to 404 pages?

                    I know that I used to be able to do this, but I can't seem to remember. One of the sites I am working on has had a lot of pages moving around lately.  I am sure some links got lost in the fray that I would like to recover, what is the easiest way to see links going to a domain that are pointing to 404 pages?

                    Technical SEO | Apr 26, 2011, 11:24 AM | MarloSchneider
                    0

                  Get started with Moz Pro!

                  Unlock the power of advanced SEO tools and data-driven insights.

                  Start my free trial
                  Products
                  • Moz Pro
                  • Moz Local
                  • Moz API
                  • Moz Data
                  • STAT
                  • Product Updates
                  Moz Solutions
                  • SMB Solutions
                  • Agency Solutions
                  • Enterprise Solutions
                  Free SEO Tools
                  • Domain Authority Checker
                  • Link Explorer
                  • Keyword Explorer
                  • Competitive Research
                  • Brand Authority Checker
                  • Local Citation Checker
                  • MozBar Extension
                  • MozCast
                  Resources
                  • Blog
                  • SEO Learning Center
                  • Help Hub
                  • Beginner's Guide to SEO
                  • How-to Guides
                  • Moz Academy
                  • API Docs
                  About Moz
                  • About
                  • Team
                  • Careers
                  • Contact
                  Why Moz
                  • Case Studies
                  • Testimonials
                  Get Involved
                  • Become an Affiliate
                  • MozCon
                  • Webinars
                  • Practical Marketer Series
                  • MozPod
                  Connect with us

                  Contact the Help team

                  Join our newsletter
                  Moz logo
                  © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                  • Accessibility
                  • Terms of Use
                  • Privacy

                  Looks like your connection to Moz was lost, please wait while we try to reconnect.