Skip to content
    Moz logo Menu open Menu close
    • Products
      • Moz Pro
      • Moz Pro Home
      • Moz Local
      • Moz Local Home
      • STAT
      • Moz API
      • Moz API Home
      • Compare SEO Products
      • Moz Data
    • Free SEO Tools
      • Domain Analysis
      • Keyword Explorer
      • Link Explorer
      • Competitive Research
      • MozBar
      • More Free SEO Tools
    • Learn SEO
      • Beginner's Guide to SEO
      • SEO Learning Center
      • Moz Academy
      • SEO Q&A
      • Webinars, Whitepapers, & Guides
    • Blog
    • Why Moz
      • Agency Solutions
      • Enterprise Solutions
      • Small Business Solutions
      • Case Studies
      • The Moz Story
      • New Releases
    • Log in
    • Log out
    • Products
      • Moz Pro

        Your all-in-one suite of SEO essentials.

      • Moz Local

        Raise your local SEO visibility with complete local SEO management.

      • STAT

        SERP tracking and analytics for enterprise SEO experts.

      • Moz API

        Power your SEO with our index of over 44 trillion links.

      • Compare SEO Products

        See which Moz SEO solution best meets your business needs.

      • Moz Data

        Power your SEO strategy & AI models with custom data solutions.

      NEW Keyword Suggestions by Topic
      Moz Pro

      NEW Keyword Suggestions by Topic

      Learn more
    • Free SEO Tools
      • Domain Analysis

        Get top competitive SEO metrics like DA, top pages and more.

      • Keyword Explorer

        Find traffic-driving keywords with our 1.25 billion+ keyword index.

      • Link Explorer

        Explore over 40 trillion links for powerful backlink data.

      • Competitive Research

        Uncover valuable insights on your organic search competitors.

      • MozBar

        See top SEO metrics for free as you browse the web.

      • More Free SEO Tools

        Explore all the free SEO tools Moz has to offer.

      What is your Brand Authority?
      Moz

      What is your Brand Authority?

      Check yours now
    • Learn SEO
      • Beginner's Guide to SEO

        The #1 most popular introduction to SEO, trusted by millions.

      • SEO Learning Center

        Broaden your knowledge with SEO resources for all skill levels.

      • On-Demand Webinars

        Learn modern SEO best practices from industry experts.

      • How-To Guides

        Step-by-step guides to search success from the authority on SEO.

      • Moz Academy

        Upskill and get certified with on-demand courses & certifications.

      • SEO Q&A

        Insights & discussions from an SEO community of 500,000+.

      Unlock flexible pricing & new endpoints
      Moz API

      Unlock flexible pricing & new endpoints

      Find your plan
    • Blog
    • Why Moz
      • Small Business Solutions

        Uncover insights to make smarter marketing decisions in less time.

      • Agency Solutions

        Earn & keep valuable clients with unparalleled data & insights.

      • Enterprise Solutions

        Gain a competitive edge in the ever-changing world of search.

      • The Moz Story

        Moz was the first & remains the most trusted SEO company.

      • Case Studies

        Explore how Moz drives ROI with a proven track record of success.

      • New Releases

        Get the scoop on the latest and greatest from Moz.

      Surface actionable competitive intel
      New Feature

      Surface actionable competitive intel

      Learn More
    • Log in
      • Moz Pro
      • Moz Local
      • Moz Local Dashboard
      • Moz API
      • Moz API Dashboard
      • Moz Academy
    • Avatar
      • Moz Home
      • Notifications
      • Account & Billing
      • Manage Users
      • Community Profile
      • My Q&A
      • My Videos
      • Log Out

    The Moz Q&A Forum

    • Forum
    • Questions
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. Home
    2. Moz Tools
    3. Moz Pro
    4. Link Explorer
    5. Rogerbot and Dotbot blocked by WP Engine hosting

    Moz Q&A is closed.

    After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

    Rogerbot and Dotbot blocked by WP Engine hosting

    Link Explorer
    3
    4
    2260
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with question management privileges can see it.
    • wearehappymedia
      wearehappymedia last edited by

      We recently discovered a problem with our MOZ account which led to checking our host's settings. Turns out that WP Engine (who we love to death) automatically BLOCK Rogerbot and Dotbot from crawling sites they host. What? Yeah exactly expect I was cursing a little too. So we went through the steps of getting that sorted one bot at a time but a week on and we're still getting 403 returns via OSE. This is more of a discussion than a question expect what I would like to see is a force crawl button so that we can test that we're no longer serving a 403 error from our host MOZ. I thought WP Engine were huge and I'm surprised this has not come up before but there's no info on it anywhere. Is there a way to force a mozbots crawl??

      1 Reply Last reply Reply Quote 0
      • wearehappymedia
        wearehappymedia last edited by

        Thanks guys I'll wait until the month cycles through and see if anything has changed.

        1 Reply Last reply Reply Quote 1
        • DavidLee
          DavidLee last edited by

          Hi Radi

          Just wanted to add that dotbot only crawls once a month while rogerbot crawls weekly. So you will not see any new metrics on OSE until we update our next Index.

          🙂

          1 Reply Last reply Reply Quote 2
          • John-Henry
            John-Henry last edited by

            Hi Radi,

            Thanks for posting your question, I'm John-Henry Scherck, Web Strategist for WP Engine.

            After some testing on our end, we are seeing Rogerbot getting status 200s when it/he crawls sites on WP Engine, I even tested it on my personal site that also runs on WP Engine and was able to crawl it successfully. However, that doesn't mean everything is resolved - we want you to get the most out of Moz and have a great experience using WP Engine 🙂

            So, the best thing to do is to submit a ticket through our user portal and we can look into the 403 issue for you.

            However, I can confirm that Dotbot has been blocked by WP Engine for some time. At least as far back as 2012, probably earlier. Normally bots get blocked for being resource intensive, but we can take an internal look at allowing Dotbot for users who need to use it. If you want to use Dotbot on your site, please fill out a ticket in the user portal and our support and tech ops teams will look into for you.

            Thanks for being a customer and please feel free to reach out to me in the future if you have any issues,

            John-Henry

            1 Reply Last reply Reply Quote 2
            • 1 / 1
            • First post
              Last post

            Got a burning SEO question?

            Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


            Start my free trial


            Browse Questions

            Explore more categories

            • Moz Tools

              Chat with the community about the Moz tools.

            • SEO Tactics

              Discuss the SEO process with fellow marketers

            • Community

              Discuss industry events, jobs, and news!

            • Digital Marketing

              Chat about tactics outside of SEO

            • Research & Trends

              Dive into research and trends in the search industry.

            • Support

              Connect on product support and feature requests.

            • See all categories

            Related Questions

            • Faizali.786

              Unsolved How to decrease spam score

              spam score link explorr

              Why spam score of my website is 78 in moz. I had disaow bad backlinks in 2023 and it's still showing my spam score too high. Help me to decrease it. alt text

              Link Explorer | | Faizali.786
              0
            • FredericoSeo

              Unsolved How to remove these spammy links

              spam backlinks spam score

              I've noticed that my website's spam score has increased recently, and upon further investigation, I found some spammy links pointing to my site. and my website www.fastlandoffer.com Moz Smap Score is 16
              5 I haven't engaged in any spammy tactics, so I'm not sure how they got there. Does anyone have any tips or suggestions on how to effectively remove these spammy links from my website and improve its overall credibility and search engine rankings? Any insights or experiences would be greatly appreciated! Thanks in advance!

              Link Explorer | | FredericoSeo
              0
            • Be7sjsj38sj

              Unsolved I have question related to Website DA.

              da

              Website DA is 4 but Ahref is showing DR 5. Why its different. Top Follow APK
              Top Follow
              Top follow for PC
              Top Follow Mod APK

              Link Explorer | | Be7sjsj38sj
              0
            • mark_seomoz1

              How do I find http backlinks to my domain?

              backlinks http

              Hi, We spotted a number of sites linking to us from http sites, not https sites. How can I use backlink tools to find just those from http sites? Right now I'm looking at exporting a spreadsheet with 3.3 million entries and filtering - and there's not one person here who wants to do that! Thanks in advance. Screen Shot 2021-11-03 at 10.49.12.png

              Link Explorer | | mark_seomoz1
              0
            • stay.hungary

              Website showing High Spam Score

              I am having a website https://www.hemporganic.net/ Suddenly I am noticing the website showing around 42% spam score. I simply cannot understand the reason behind it. The website contains only one backlink and that too it is guest posting backlink. Please explain to me why this is occurring with my site.

              Link Explorer | | stay.hungary
              10
            • rajas2019

              New backlinks not getting index

              Hi.
              I have been creating backlinks for my website since 2 months. The backlinks are from different linking domains. The issue is that moz is not showing me all the backlinks that i have created. It is displaying only 10% of all the backlinks of my domain bestessaywritingservice.org homepage. Is there any way to tell moz about all the backlinks i'm building?
              Thanks

              Link Explorer | | rajas2019
              0
            • waqazolqa

              Why my domain authority is low

              hey moz community i want to ask something i have blog on https://bestbeginnerguitars.net/ guitars.this blog is 7 months old and i created backlink on it.but today i am checking DA of my website its 7 how can i increase it

              Link Explorer | | waqazolqa
              1
            • CinivaAgency

              WP Events Calendar Creates URLs Too Long in Site Crawler

              My travel/tourism site is on WP and using an Events plugin that ads a calendar of events to many pages. The MOZ crawler is indexing almost 46K links with a URL too long, but the site only has about 3.8K pages indexed in Google. I can tell MOZ is indexing the same pages over and over again but just adding a random calendar month and year.  Here are some examples. https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country[0]=US&ajaxCalendar=1&mo=10&yr=2003 https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=10&yr=2034 https://www.visitcurrituck.com/beach-houses-family-time/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=1&yr=1873 Any advice on how to prevent MOZ from indexing this way? I don't believe that Google is seeing this also, but maybe they are. I just know my site has over 63K issues and I'm sure at least 75% or more is because of the way they are picking up on the events calendar. Thanks!

              Link Explorer | | CinivaAgency
              1

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter

            Access all your tools in one place. Whether you're tracking progress or analyzing data, everything you need is at your fingertips.

            Moz logo
            © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy

            Looks like your connection to Moz was lost, please wait while we try to reconnect.