Server blocking crawl bot due to DOS protection and MOZ Help team not responding
-
First of all has anyone else not received a response from the help team, ive sent 4 emails the oldest one is a month old, and one of our most used features on moz on demand crawl to find broken links doesnt work and its really frustrating to not get a response, when we're paying so much a month for a feature that doesnt work.
Ok rant over now onto the actual issue, on our crawls we're just getting 429 errors because our server has a DOS protection and is blocking MOZ's robot, im sure it will be as easy as whitelisting the robots IP, but i cant get a response from MOZ with the IP.
Cheers, Fergus
-
Hi dave thanks for your response ill let our server provider the user agent.
I was contacting you using the contact form, putting in my email which is the same as the one used to log into moz, but not the email that was used when creating the account, which i think might've been the issue.
-
Hi Dougal!
We don't have any record of support requests coming from the email associated with your Moz Pro account. Can you let us know how you are reaching out (contact form or emailing us directly at help@moz.com)?
Unfortunately, we do not use a static IP address or range of IP addresses, as we have designed our crawler to have a dynamic approach. This means we use thousands of dynamic IP addresses which will change each time we run a crawl. This approach gives us the best dynamic view of the web, but it can make us incompatible with some servers or hosting providers. The best option I'd be able to suggest would be to identify our crawler by User-agent: rogerbot
You can read more about rogerbot in our guide.
Look forward to hearing back!
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
No access to the Analytics part of the website. Help?
I have accepted a seat on my managers subscription to help look into our website and the analytics part specifically but every time I try to access wither the keyword explorer or any other of the analytics part of the website it appears that there is a broken link and will just show a white screen with only the headers and footers intact.
Feature Requests | | libbyh2019
Could someone please let me know how to resolve the issue?
Kind regards,
Olivia Houghton.0 -
Moz's New Video Ads on YouTube
I've enjoyed Moz's new video ads and want to share them with colleagues, however am unable to find the vids anywhere other than when they're delivered before a video plays on YouTube. Are they available on demand? If anyone is unfamiliar with the videos I speak of, they are new ads for Moz products like Keyword Explorer, Mozbar, and MozCon. Thanks in advance!
Feature Requests | | Choice0 -
Does seo moz toolbar work in safari? Can I avoid using Chrome or firefox?
I am using a Mac and use Safari for web. I am not very familiar with Google Chrome or Firefox. I started my trial with SEOMoz Pro and want to use it (loved it) but do not want to adapt myself to Google Chrome or Firefox - thus my hesitation. What limitations do I have with SEOMoz Pro in safari - e.g. Moz add-on in the toolbar? What would I be missing if I continue using Safari? I would much appreciate an honest and complete answer so that I can decide whether to use Google Chrome of Firefox. Thank you
Feature Requests | | Cenktukel0 -
Does moz offer a site auditor tool to imbed on your website?
similar service as http://mysiteauditor.com. just want to embed a tool on our website that allows the visitor to enter their url and have a report emailed to them.
Feature Requests | | WebMarkets1 -
Moz Local - Does it do the work for you?
Good Morning Everyone, I have a quick question regarding Moz Local ... I understand what it does and the purpose and how great it is... My question is this: If you sign up for Moz local, does it actually send all of the proper and necessary info to each of the aggregators or sites that it lists or does it simply tell me what information i need to send them and i have to provide this info to each one myself? For example, does it say something like "Inconsistent info found on Yelp, please do this to correct" .... OR, does it actually make the corrections and send to yelp for me? Thanks
Feature Requests | | Prime850 -
Moz Weekly Keyword Ranking Received seems inaccurate - Australia
Hi, We have so many website being tracked in Google AU and we see too much ranking change ( both positive and negative ) but all inaccurate from MOZ. Our Manual Testing result matched correctly with Google where as moz results inaccurate. Is there anything happening . Our Website: http://www.gardenshed.com.au/ E.g : Garden shed - Moz Reported Rank #4 - Actual Rank : 11 Garden sheds - Moz Reported Rank #7 - Actual Rank : 23 similarly for all other projects .
Feature Requests | | emarketexperts0 -
Crawl diagnostic errors due to query string
I'm seeing a large amount of duplicate page titles, duplicate content, missing meta descriptions, etc. in my Crawl Diagnostics Report due to URLs' query strings. These pages already have canonical tags, but I know canonical tags aren't considered in MOZ's crawl diagnostic reports and therefore won't reduce the number of reported errors. Is there any way to configure MOZ to not consider query string variants as unique URLs? It's difficult to find a legitimate error among hundreds of these non-errors.
Feature Requests | | jmorehouse0 -
My moz.com profile page authority has vanished.
Hi there Anybody has seen his page authority regarding his own profile page from moz.com vanishing? Mine was aproximately 46, now PA=1 I´ve checked it and nobody is making any comments about this so maybe.... it´s just me :S? Any clues? I loved my link from moz.com!!! Cheers Claudio Heilborn
Feature Requests | | ClaudioHeilborn0