undefined
Skip to content
Moz logo Menu open Menu close
  • Products
    • Moz Pro
    • Moz Pro Home
    • Moz Local
    • Moz Local Home
    • STAT
    • Moz API
    • Moz API Home
    • Compare SEO Products
    • Moz Data
  • Free SEO Tools
    • Domain Analysis
    • Keyword Explorer
    • Link Explorer
    • Competitive Research
    • MozBar
    • More Free SEO Tools
  • Learn SEO
    • Beginner's Guide to SEO
    • SEO Learning Center
    • Moz Academy
    • SEO Q&A
    • Webinars, Whitepapers, & Guides
  • Blog
  • Why Moz
    • Agency Solutions
    • Enterprise Solutions
    • Small Business Solutions
    • Case Studies
    • The Moz Story
    • New Releases
  • Log in
  • Log out
  • Products
    • Moz Pro

      Your all-in-one suite of SEO essentials.

    • Moz Local

      Raise your local SEO visibility with complete local SEO management.

    • STAT

      SERP tracking and analytics for enterprise SEO experts.

    • Moz API

      Power your SEO with our index of over 44 trillion links.

    • Compare SEO Products

      See which Moz SEO solution best meets your business needs.

    • Moz Data

      Power your SEO strategy & AI models with custom data solutions.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Free SEO Tools
    • Domain Analysis

      Get top competitive SEO metrics like DA, top pages and more.

    • Keyword Explorer

      Find traffic-driving keywords with our 1.25 billion+ keyword index.

    • Link Explorer

      Explore over 40 trillion links for powerful backlink data.

    • Competitive Research

      Uncover valuable insights on your organic search competitors.

    • MozBar

      See top SEO metrics for free as you browse the web.

    • More Free SEO Tools

      Explore all the free SEO tools Moz has to offer.

    What is your Brand Authority?
    Moz

    What is your Brand Authority?

    Check yours now
  • Learn SEO
    • Beginner's Guide to SEO

      The #1 most popular introduction to SEO, trusted by millions.

    • SEO Learning Center

      Broaden your knowledge with SEO resources for all skill levels.

    • On-Demand Webinars

      Learn modern SEO best practices from industry experts.

    • How-To Guides

      Step-by-step guides to search success from the authority on SEO.

    • Moz Academy

      Upskill and get certified with on-demand courses & certifications.

    • SEO Q&A

      Insights & discussions from an SEO community of 500,000+.

    Unlock flexible pricing & new endpoints
    Moz API

    Unlock flexible pricing & new endpoints

    Find your plan
  • Blog
  • Why Moz
    • Small Business Solutions

      Uncover insights to make smarter marketing decisions in less time.

    • Agency Solutions

      Earn & keep valuable clients with unparalleled data & insights.

    • Enterprise Solutions

      Gain a competitive edge in the ever-changing world of search.

    • The Moz Story

      Moz was the first & remains the most trusted SEO company.

    • Case Studies

      Explore how Moz drives ROI with a proven track record of success.

    • New Releases

      Get the scoop on the latest and greatest from Moz.

    Surface actionable competitive intel
    New Feature

    Surface actionable competitive intel

    Learn More
  • Log in
    • Moz Pro
    • Moz Local
    • Moz Local Dashboard
    • Moz API
    • Moz API Dashboard
    • Moz Academy
  • Avatar
    • Moz Home
    • Notifications
    • Account & Billing
    • Manage Users
    • Community Profile
    • My Q&A
    • My Videos
    • Log Out

The Moz Q&A Forum

  • Forum
  • Questions
  • Users
  • Ask the Community

Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

  1. Home
  2. SEO Tactics
  3. Intermediate & Advanced SEO
  4. 404's - Do they impact search ranking/how do we get rid of them?

Moz Q&A is closed.

After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

404's - Do they impact search ranking/how do we get rid of them?

Intermediate & Advanced SEO
5
19
6.5k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as question
Log in to reply
This topic has been deleted. Only users with question management privileges can see it.
  • carlystemmer
    carlystemmer last edited by Oct 31, 2014, 2:15 PM

    Hi,

    We recently ran the Moz website crawl report and saw a number of 404 pages from our site come back. These were returned as "high priority" issues to fix. My question is, how do 404's impact search ranking? From what Google support tells me, 404's are "normal" and not a big deal to fix, but if they are "high priority" shouldn't we be doing something to remove them?

    Also, if I do want to remove the pages, how would I go about doing so? Is it enough to go into Webmaster tools and list it as a link no to crawl anymore or do we need to do work from the website development side as well?

    Here are a couple of examples that came back..these are articles that were previously posted but we decided to close out:

    http://loyalty360.org/loyalty-management/september-2011/let-me-guessyour-loyalty-program-isnt-working

    http://loyalty360.org/resources/article/mark-johnson-speaks-at-motivation-show

    Thanks!

    1 Reply Last reply Reply Quote 0
    • evolvingSEO
      evolvingSEO @carlystemmer last edited by Nov 4, 2014, 1:03 PM Nov 4, 2014, 1:03 PM

      Hi

      As far as I know there is no way to do this in webmaster tools. You can test your robots.txt file with the Robots.txt Tester - but you need to actually update the real file to block URLs from being crawled.

      At any rate, normally you would not block 404s from being crawled - Google with either stop crawling them on their own, or this way if they are indexed they can drop out of the index.

      1 Reply Last reply Reply Quote 0
      • carlystemmer
        carlystemmer @evolvingSEO last edited by Nov 4, 2014, 1:23 AM Nov 4, 2014, 1:23 AM

        By submit to webmaster tools, I meant submit the link so Google will not crawl it again.

        evolvingSEO 1 Reply Last reply Nov 4, 2014, 1:03 PM Reply Quote 0
        • evolvingSEO
          evolvingSEO @carlystemmer last edited by Nov 3, 2014, 11:12 PM Nov 3, 2014, 11:12 PM

          What do you mean by "submit links to Google Webmaster Tools"? As far as I know there isn't a way to submit 404 URLs in there.

          The way to solve 404s are;

          • make the URL a real page again (if it broke by accident)
          • remove links pointing at the bad page
          • 301 redirect the 404 page to one that works
          • you can opt to leave it alone if there was nothing important on that page and there is no good page to redirect it to

          404s might hurt rankings, but only in extreme cases where it was a popular page and now you're losing the back link value or referral traffic etc. I'd say in 90/100 cases 404s will not hurt your rankings.

          carlystemmer 1 Reply Last reply Nov 4, 2014, 1:23 AM Reply Quote 0
          • carlystemmer
            carlystemmer @evolvingSEO last edited by Nov 3, 2014, 8:18 PM Nov 3, 2014, 8:18 PM

            Interesting - good to know! So even when we submit these links to Google Webmaster tools, that doesn't solve the problem, correct? Even if Google isn't crawling these links (eventually) will it still hurt SEO rankings overall?

            evolvingSEO 1 Reply Last reply Nov 3, 2014, 11:12 PM Reply Quote 0
            • carlystemmer
              carlystemmer @MonicaOConnor last edited by Nov 3, 2014, 8:13 PM Nov 3, 2014, 8:13 PM

              Got it. So I guess we need to decide what makes sense work-load wise and what is best for the site. If we do 301 redirects, is that seen as more beneficial than an "engaging" 404 page that allows people to go to another page?

              It seems like the 404 page would be one project where constantly adding in 301 redirects would be a lot of work.

              1 Reply Last reply Reply Quote 0
              • MonicaOConnor
                MonicaOConnor @carlystemmer last edited by Nov 3, 2014, 8:06 PM Nov 3, 2014, 8:06 PM

                Theoretically a 404 error is a deleted page. To get rid of the 404 error you have to redirect the broken link, or deleted page.

                carlystemmer 1 Reply Last reply Nov 3, 2014, 8:13 PM Reply Quote 1
                • carlystemmer
                  carlystemmer @MonicaOConnor last edited by Nov 3, 2014, 8:05 PM Nov 3, 2014, 8:05 PM

                  Is there no way to just completely remove or delete a page/404 or it will always exist on some level?

                  MonicaOConnor 1 Reply Last reply Nov 3, 2014, 8:06 PM Reply Quote 0
                  • evolvingSEO
                    evolvingSEO last edited by Nov 3, 2014, 2:47 AM Nov 3, 2014, 2:47 AM

                    Hey There

                    Google's webmaster documentation says;

                    "Generally, 404 errors don’t impact your site’s ranking in Google, and you can safely ignore them."

                    When Google says "generally" this tends to mean "in most cases" or "not directly" or "there may be secondary effects"... you get the idea. 🙂

                    But I think they are assuming you need to be smart enough to know if the 404 was intentional, and if not why it happened. For example - if you had a really popular piece of content with back links directly to that URL, and then the URL 404s - you supposed may lose the "link juice" pointing into that article. So in that regard 404s can hurt rankings secondarily.

                    But as other have said, you can redirect your 404s to a similar page (Google recommends not the homepage).

                    I am not sure why the Moz report puts them in "high priority" - perhaps they mean "high priority" from a general web best practice point of view, and not strictly SEO.

                    carlystemmer 1 Reply Last reply Nov 3, 2014, 8:18 PM Reply Quote 2
                    • adamxj2
                      adamxj2 @carlystemmer last edited by Oct 31, 2014, 5:03 PM Oct 31, 2014, 5:03 PM

                      With that many I would suggest redirecting them to a relevant page rather than just stopping the indexing of them by submitting the links to Google Webmaster Tools. From what I've experienced, keeping the link juice flowing through your site by redirecting them is better for your overall SEO efforts.

                      Of course it's faster to submit the links to GWT…but that doesn't necessarily mean it's better. Regardless of what you do or how you do it, eliminating your crawl errors is very important.

                      1 Reply Last reply Reply Quote 0
                      • MonicaOConnor
                        MonicaOConnor @carlystemmer last edited by Oct 31, 2014, 4:39 PM Oct 31, 2014, 4:39 PM

                        https://www.youtube.com/watch?v=9tz7Eexwp_A

                        This is video by Matt Cutts that gives some great advice. My goal is always to redirect them, even if it is back to the main article category page or even the home page. I hate the thought of losing a potential customer to a 404 error. This has to be your decision though.

                        Errors are not good, no matter what kind of error they are. Best practice is to remove any error you can. When your bounce rate increases you lose ranking power. When you have broken links, you lose searchers. That is the simplest way to put it.

                        carlystemmer 1 Reply Last reply Nov 3, 2014, 8:05 PM Reply Quote 1
                        • MonicaOConnor
                          MonicaOConnor @carlystemmer last edited by Oct 31, 2014, 4:36 PM Oct 31, 2014, 4:36 PM

                          Fix them, redirect them back to a relevant page and then mark them as fixed in GWT.

                          1 Reply Last reply Reply Quote 2
                          • carlystemmer
                            carlystemmer @adamxj2 last edited by Oct 31, 2014, 3:54 PM Oct 31, 2014, 3:54 PM

                            When we ran the MOZ report it said we had more than a couple...probably around 50 or so. Our website has been around 5-6 years and I don't think we have ever done anything with any of them. With this many errors, what is your suggestion? Would it be faster to submit the link to Google Webmaster tools than waiting for them to be crawled again?

                            MonicaOConnor adamxj2 2 Replies Last reply Oct 31, 2014, 5:03 PM Reply Quote 0
                            • MonicaOConnor
                              MonicaOConnor @JVRudnick last edited by Oct 31, 2014, 3:51 PM Oct 31, 2014, 3:51 PM

                              404's can reduce your ability to rank highly for keywords when they effect your bounce rate and lower your impressions. Consider it giving your website a bad reputation. Again, it takes a lot of them to do this.

                              1 Reply Last reply Reply Quote 1
                              • carlystemmer
                                carlystemmer @MonicaOConnor last edited by Oct 31, 2014, 3:45 PM Oct 31, 2014, 3:45 PM

                                We are using Expression Engine. A lot of the links are within our own site - they are articles we once posted, but then we decided to close for one reason or another, and now they are throwing a 404 error. We don't necessarily have anything to redirect them to since they are mostly just random article pieces, which is why we were looking into deleting them completely.

                                MonicaOConnor 1 Reply Last reply Oct 31, 2014, 4:39 PM Reply Quote 0
                                • adamxj2
                                  adamxj2 @JVRudnick last edited by Oct 31, 2014, 3:41 PM Oct 31, 2014, 3:41 PM

                                  There's tons of documentation stating that 404's negatively affect SEO. It's definitely debatable and there are obviously other factors involved. My main point is that it's important to deal with any and all crawl errors.

                                  1 Reply Last reply Reply Quote 1
                                  • JVRudnick
                                    JVRudnick last edited by Oct 31, 2014, 3:11 PM Oct 31, 2014, 3:11 PM

                                    adamxj2 re: "... having too many at once can negatively affect your rankings...."

                                    ???

                                    on what testing do you quote that? As my own SEO world includes no such assumptions or proof of same!

                                    WHAT a 404 will affect is conversions...no one who shows up on a site after taking a link into same and finding a 404 will ever get a feeling other than if a site can't fix it's 404's then why would I belive they can sell me something etc.

                                    404's do NOT affect rankings....they disappear on their own it's true...but I always fix same asap!

                                    adamxj2 MonicaOConnor 2 Replies Last reply Oct 31, 2014, 3:51 PM Reply Quote 0
                                    • adamxj2
                                      adamxj2 last edited by Oct 31, 2014, 2:56 PM Oct 31, 2014, 2:51 PM

                                      Hello!

                                      Although 404's will eventually stop being crawled by Google, having too many at once can negatively affect your rankings. The  most important thing is that you do not want to be linking to these 404s anywhere from within your site. If so, you want to definitely remove those links.

                                      If I have one or two 404s in my crawl errors, I typically will just leave them be and wait for them to be dropped out of being indexed. Some other solutions I've utilized are:

                                      1. Make an engaging 404 page so that when users find the page they will be encouraged to stay on the website. Having a search box or some of the most popular links on the page is a good place to start

                                      2. 301 redirect the pages to relevant pages that do exist. This will help your link juice flow and will make for a good user experience since they are reaching a relevant page.

                                      Hope that helps!

                                      carlystemmer 1 Reply Last reply Oct 31, 2014, 3:54 PM Reply Quote 3
                                      • MonicaOConnor
                                        MonicaOConnor last edited by Oct 31, 2014, 2:45 PM Oct 31, 2014, 2:45 PM

                                        I would log in to GWT and look at your 404 errors under crawl errors. In there you will see where the links are still linked from. If they are pointing at external sites, I would redirect them. I don't know what platform you are using, but you should be able to do this in the admin section of your platform.

                                        If they aren't linked externally, you should probably still redirect them. I know the Google says that 404 errors are harmless, but if you have dead links on your site and someone clicks on it, it most likely results in a lost searcher.

                                        Hope that helps!

                                        carlystemmer 1 Reply Last reply Oct 31, 2014, 3:45 PM Reply Quote 1
                                        • 1 / 1
                                        1 out of 19
                                        • First post
                                          1/19
                                          Last post

                                        Got a burning SEO question?

                                        Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


                                        Start my free trial


                                        Browse Questions

                                        Explore more categories

                                        • Moz Tools

                                          Chat with the community about the Moz tools.

                                        • SEO Tactics

                                          Discuss the SEO process with fellow marketers

                                        • Community

                                          Discuss industry events, jobs, and news!

                                        • Digital Marketing

                                          Chat about tactics outside of SEO

                                        • Research & Trends

                                          Dive into research and trends in the search industry.

                                        • Support

                                          Connect on product support and feature requests.

                                        • See all categories

                                        Related Questions

                                        • rickyporco

                                          After hack and remediation, thousands of URL's still appearing as 'Valid' in google search console. How to remedy?

                                          I'm working on a site that was hacked in March 2019 and in the process, nearly 900,000 spam links were generated and indexed. After remediation of the hack in April 2019, the spammy URLs began dropping out of the index until last week, when Search Console showed around 8,000 as "Indexed, not submitted in sitemap" but listed as "Valid" in the coverage report and many of them are still hack-related URLs that are listed as being indexed in March 2019, despite the fact that clicking on them leads to a 404. As of this Saturday, the number jumped up to 18,000, but I have no way of finding out using the search console reports why the jump happened or what are the new URLs that were added, the only sort mechanism is last crawled and they don't show up there. How long can I expect it to take for these remaining urls to also be removed from the index? Is there any way to expedite the process? I've submitted a 'new' sitemap several times, which (so far) has not helped. Is there any way to see inside the new GSC view why/how the number of valid URLs in the indexed doubled over one weekend?

                                          Intermediate & Advanced SEO | Aug 12, 2019, 8:56 AM | rickyporco
                                          0
                                        • rmehta1

                                          [Very Urgent] More 100 "/search/adult-site-keywords" Crawl errors under Search Console

                                          I just opened my G Search Console and was shocked to see more than 150 Not Found errors under Crawl errors. Mine is a Wordpress site (it's consistently updated too): Here's how they show up: Example 1: URL: www.example.com/search/adult-site-keyword/page2.html/feed/rss2 Linked From: http://an-adult-image-hosting.com/search/adult-site-keyword/page2.html Example 2 (this surprised me the most when I looked at the linked from data): URL: www.example.com/search/adult-site-keyword-2.html/page/3/ Linked From: www.example.com/search/adult-site-keyword-2.html/page/2/ (this is showing as if it's from our own site) http://a-spammy-adult-site.com/search/adult-site-keyword-2.html Example 3: URL: www.example.com/search/adult-site-keyword-3.html Linked From: http://an-adult-image-hosting.com/search/adult-site-keyword-3.html How do I address this issue?

                                          Intermediate & Advanced SEO | Dec 23, 2016, 3:53 PM | rmehta1
                                          0
                                        • SEOhmygod

                                          Does content revealed by a 'show more' button get crawled by Google?

                                          I have a div on my website with around 500 words of unique content in, automatically when the page is first visited the div has a fixed height of 100px, showing a couple of hundred words and fading out to white, with a show more button, which when clicked, increases the height to show the full content. My question is, does Google crawl the content in that div when it renders the page? Or disregard it? Its all in the source code. Or worse, do they consider this cloaking or hidden content? It is only there to make the site more useable for customers, so i don't want to get penalised for it. Cheers

                                          Intermediate & Advanced SEO | Oct 11, 2016, 9:41 PM | SEOhmygod
                                          0
                                        • dancape

                                          Using the same content on different TLD's

                                          HI Everyone, We have clients for whom we are going to work with in different countries but sometimes with the same  language. For example we might have a client in a competitive niche working in Germany, Austria and Switzerland (Swiss German) ie we're going to potentially rewrite our website three times in German, We're thinking of using Google's href lang tags and use pretty much the same content - is this a safe option, has anyone actually tries this successfully or otherwise? All answers appreciated. Cheers, Mel.

                                          Intermediate & Advanced SEO | Apr 16, 2014, 9:04 AM | dancape
                                          1
                                        • esiow2013

                                          May know what's the meaning of these parameters in .htaccess?

                                          Begin HackRepair.com Blacklist RewriteEngine on Abuse Agent Blocking RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Bolt\ 0 [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto:craftbot@yahoo.com [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} CazoodleBot [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Custo [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Default\ Browser\ 0 [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^DIIbot [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^DISCo [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} discobot [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Download\ Demon [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^eCatch [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ecxi [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^EmailCollector [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Express\ WebPictures [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^FlashGet [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^GetRight [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^GetWeb! [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^GrabNet [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Grafula [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} GT::WWW [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} heritrix [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^HMView [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} HTTP::Lite [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} HTTrack [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ia_archiver [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} IDBot [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} id-search [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} id-search.org [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Image\ Stripper [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Image\ Sucker [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} Indy\ Library [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^InterGET [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^InternetSeer.com [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} IRLbot [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ISC\ Systems\ iRc\ Search\ 2.1 [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Java [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^JetCar [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^JOC\ Web\ Spider [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^larbin [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^LeechFTP [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} libwww [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} libwww-perl [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Link [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} LinksManager.com_bot [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} linkwalker [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} lwp-trivial [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Maxthon$ [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} MFC_Tear_Sample [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^microsoft.url [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} Microsoft\ URL\ Control [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} Missigua\ Locator [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Mozilla.*Indy [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Mozilla.NEWT [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^MSFrontPage [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Navroad [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^NearSite [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^NetAnts [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^NetSpider [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^NetZIP [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Nutch [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Octopus [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Offline\ Navigator [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} panscient.com [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^pavuk [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} PECL::HTTP [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^PeoplePal [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} PHPCrawl [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} PleaseCrawl [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^psbot [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^RealDownload [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^ReGet [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Rippers\ 0 [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} SBIder [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^SeaMonkey$ [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^sitecheck.internetseer.com [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} Snoopy [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} Steeler [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^SuperBot [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Surfbot [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Toata\ dragostea\ mea\ pentru\ diavola [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} URI::Fetch [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} urllib [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} User-Agent [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} Web\ Sucker [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} webalta [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^WebAuto [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^[Ww]eb[Bb]andit [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} WebCollage [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^WebCopier [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^WebFetch [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^WebGo\ IS [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^WebLeacher [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^WebReaper [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^WebSauger [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Website\ eXtractor [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^WebStripper [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^WebZIP [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} Wells\ Search\ II [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} WEP\ Search [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Wget [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Widow [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^WWW-Mechanize [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^WWWOFFLE [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} zermelo [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^Zeus [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ^(.)Zeus.Webster [NC,OR]
                                          RewriteCond %{HTTP_USER_AGENT} ZyBorg [NC]
                                          RewriteRule ^. - [F,L] Abuse bot blocking rule end End HackRepair.com Blacklist

                                          Intermediate & Advanced SEO | Sep 22, 2013, 12:47 PM | esiow2013
                                          1
                                        • James77

                                          Posing QU's on Google Variables "aclk", "gclid" "cd", "/aclk" "/search", "/url" etc

                                          I've been doing a bit of stats research prompted by read the recent ranking blog http://www.seomoz.org/blog/gettings-rankings-into-ga-using-custom-variables There are a few things that have come up in my research that I'd like to clear up. The below analysis has been done on my "conversions". 1/. What does "/aclk" mean in the Referrer URL? I have noticed a strong correlation between this and "gclid" in the landing page variable. Does it mean "ad click" ?? Although they seem to "closely" correlate they don't exactly, so when I have /aclk in the referrer Url MOSTLY I have gclid in the landing page URL. BUT not always, and the same applies vice versa. It's pretty vital that I know what is the best way to monitor adwords PPC, so what is the best variable to go on? - Currently I am using "gclid", but I have about 25% extra referral URL's with /aclk in that dont have "gclid" in - so am I underestimating my number of PPC conversions? 2/. The use of the variable "cd" is great, but it is not always present. I have noticed that 99% of my google "Referrer URL's" either start with:
                                          /aclk   - No cd value
                                          /search - No cd value
                                          /url - Always contains the cd variable. What do I make of this?? Thanks for the help in advance!

                                          Intermediate & Advanced SEO | Oct 26, 2011, 5:33 AM | James77
                                          0
                                        • wojkwasi

                                          Will using a service such as Akamai impact on rankings?

                                          Howdy 🙂 My client has a .com site they are looking at hosting via Akamai - they have offices in various locations, e.g UK, US, AU, RU & in some Asian countries. If they used Akamai, would the best approach be to set up seperate sites per country: .co.uk .com .com.au .ru .sg etc Although my understanding is that Googlebot is located in the US so if it crawled any of those sites it would always get a US IP address? So is the answer perhaps to go with Akamai for the .com only which should target the US market and use different / seperate C class hosts for the others? Thanks! Woj

                                          Intermediate & Advanced SEO | Aug 9, 2011, 7:14 PM | wojkwasi
                                          0
                                        • JamesO

                                          To subnav or NOT to subnav... that's my question.... :)

                                          We are working on a new website that is golf related and wondering about whether or not we should set up a subnavigation dropdown menu from the main menu. For example: GOLF PACKAGES
                                            >> 2 Round Packages
                                            >> 3 Round Packages
                                            >> 4 Round Packages
                                            >> 5 Round Packages GOLF COURSES
                                            >> North End Courses
                                            >> Central Courses
                                            >> South End Courses This would actually be very beneficial to our users from a usability standpoint, BUT what about from an SEO standpoint? Is diverting all the link juice to these inner pages from the main site navigation harmful?  Should we just create a page for GOLF PACKAGES and break it down on that page?

                                          Intermediate & Advanced SEO | Apr 25, 2011, 6:07 PM | JamesO
                                          0

                                        Get started with Moz Pro!

                                        Unlock the power of advanced SEO tools and data-driven insights.

                                        Start my free trial
                                        Products
                                        • Moz Pro
                                        • Moz Local
                                        • Moz API
                                        • Moz Data
                                        • STAT
                                        • Product Updates
                                        Moz Solutions
                                        • SMB Solutions
                                        • Agency Solutions
                                        • Enterprise Solutions
                                        Free SEO Tools
                                        • Domain Authority Checker
                                        • Link Explorer
                                        • Keyword Explorer
                                        • Competitive Research
                                        • Brand Authority Checker
                                        • MozBar Extension
                                        • MozCast
                                        Resources
                                        • Blog
                                        • SEO Learning Center
                                        • Help Hub
                                        • Beginner's Guide to SEO
                                        • How-to Guides
                                        • Moz Academy
                                        • API Docs
                                        About Moz
                                        • About
                                        • Team
                                        • Careers
                                        • Contact
                                        Why Moz
                                        • Case Studies
                                        • Testimonials
                                        Get Involved
                                        • Become an Affiliate
                                        • MozCon
                                        • Webinars
                                        • Practical Marketer Series
                                        • MozPod
                                        Connect with us

                                        Contact the Help team

                                        Join our newsletter
                                        Moz logo
                                        © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                                        • Accessibility
                                        • Terms of Use
                                        • Privacy

                                        Looks like your connection to Moz was lost, please wait while we try to reconnect.