Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Does using Sucuri block Moz?
-
I am using Opensite explorer on my site which uses Sucuri and it shows 0 for everything. Does Sucuri stop MOZ from reading the link?
I also suspect that using Sucuri has made my SEO suffer because the first page is always saying "redirecting" . Anyone with experience to this? Thanks
-
I use Sucuri cloud proxy and it has never affected my sites in any way. If you tell it to block the IP's or referral domain it will do so. If you do not it considers Moz/ Roger Bot & Dot Bot as white hat and does not block them unless you request that it does.
their user agents are right here
http://moz.com/community/q/what-is-the-full-user-agent-for-rogerbot
-
you can request that Sucuri check and make sure you are not being blocked. With that said I just ran a test on the site above and the only bots that are being blocked bad bots.
-
if you find this is not true for you simply tell Sucuri.net support inside the dashboard to Speak to support There phone number is 1–888–873–0817 they will tell security operations Center or( SOC) to white list anything you want white listed
-
Could you possibly share a screenshot of the redirect your talking about?
-
Tt sounds to me like you have a redirect issue on your server that could be blocking dotbot ( the bot for open site Explorer)
-
To determine whether or not a robots.txt file or a no index page is doing this please use the tools below their free and will give us a lot of information quickly & make sure your robots.txt is not blocking it.
-
To check regarding search engines or bots being redirected using this tool
-
http://tools.seochat.com/tools/search-engine-friendly-redirect-checker/
-
to re-create a robots.txt file that works and will not block anything if that is the case use this tool.
-
http://tools.seochat.com/tools/online-robots-txt-generator/ ( Site maps may not be official but do help if they're in the robots.txt file)
** last but not least run your site through this tool and make sure nothing is out of whack.**
- http://www.feedthebot.com/tools/
- http://moz.com/tools/crawl-test ( do not be surprised if this does not work as may use the same bot being blocked by a number of different things)
- If you continue to have problems and Sucuri tell you that they are not blocking it.
- Look into using Deepcrawl.co.uk or screaming frog SEO spider
- I even run a free audit on deep crawl for you if everything above does not work.
I hope this helps,
Tom
-
-
Thanks Joe for the thumbs up on Sucuri based on your experience. Have tweaked the settings on Sucuri and opensite is able to detect it. Will continue to monitor it.
Appreciate the sharing of your experience with Sucuri, Joe.
Eric
-
Thanks Abe, you are right. Went to tweak the settings at sucuri and the opensite explorer worked. Cheers and appreciate the response
-
Thanks for the reply Ryan. Appreciate.
Robot.txt is ok, went to tweak the settings in sucuri and the opensite is able to detect it.
Cheers,
Eric
-
We do use Sucuri on some of our clients websites with high rankings and no crawl or ranking issues. I agree with Ryan it's some other issue you are having. Just wanted to let you know from direct experience with Sucuri not having any issues for us. Best Regards,
Joe
-
Hello and thanks for reaching out to us! While I don't have any personal experience with Sucuri, there are certainly website protection tools out there that can mess with our crawl attempts. If you can send your campaign name and web address to help@moz.com, we'd love to take a look at that for you!
-
Doubtful. Several sites mentioned on their clients page are showing numbers in OSE. Try out a few from: https://sucuri.net/clients/. Chances are you have a robots.txt issue blocking OSE, the site is brand new, or it's on a tld domain that is currently not compatible with OSE, such as http://example.website If you list your site here more details could be provided. Cheers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why my website Backlinks not getting Crawl by Moz?
Hi, I've the query related to backlinks of my website. Some of the high authority sites give backlinks to my website but these links are still not showing in Moz. My website is 6 months old and also continuously getting backlinks from high authority sites but still these are not showing on Moz and also not improving DA and PA of my website. I've also attached the screenshot of Moz link explorer results please check and guide me what to do with website so Moz will consider it and give some authority. And also guide me How much Moz takes time to crawl website backlinks and shown in their link explorer. Website URL: https://www.welderexpert.com Moz Expert Suggestions needed. Thanks, overview?site=welderexpert.com⌖=domain
Link Explorer | | KOidue0 -
Moz tool to estimate a website's organic traffic?
Moz has tons of great tools, so I was quite suprised there is nothing similar to Alexa's siteinfo tool, or SimilarWeb's site comparison tool. Am I missing something? Or does such a tool exists at Moz? Or is there a different way of estimating my competitor's traffic? It would be great if Moz would have something like that.
Link Explorer | | GrandRapids0 -
How to index backlinks in moz?
hello my website has some backlinks from high authority website that has been indexed by google but moz is not indexing my backlinks and also my pages so what should i do?
Link Explorer | | yuewiioweiwjksa38320 -
Is Moz's backlink checker.... just... not good?
Hey everyone! Can somebody explain to me why this keeps happening: Whenever I'm trying to backlink my competitors, I typically use RavenTools. Every time, without fail, if I put that same URL into Moz's Open Site Explorer - It gives me about 1/20th of what RavenTools shows me. Sometimes it literally comes up with 2 or 3 links total. Unfortunately, RavenTools has a cap on how many backlink checks you can perform in a month - so once I've used those up, I have to start using OSE... But, it just doesn't work. Does anyone else have this issue? Thanks!
Link Explorer | | TaylorRHawkins1 -
Fastest way to get new backlinks recognised by Moz?
Hi all, I have seen a few discussions / advice pieces around this, but wondered what the current view is on the fastest way to get new backlinks recognised by Moz? I have seen people say that the content needs to be shared (e.g. on Twitter), and advice around creating Bitly links. I am not convinced that these techniques are working. On a related note, my website is very large. I have around 2.5m pages. Most of these pages are 3-4 clicks from the home page, but I have a small amount of important content much higher up in the site (1-2 clicks from the home page). Does Moz crawl pages nearer the home page more frequently, or does it make a pass of all pages on the site before it starts at the beginning again? If it makes a complete pass of all pages, then presumably making my site smaller will help to get Moz to see new content more quickly? Is there any other value to be gained in making a large site smaller? Many thanks in advance, Neil.
Link Explorer | | NHARRIS10 -
Does Moz have anything similar to ahrefs batch analysis tool?
I am wanting to do analysis of a whole bunch of URLs at once - i know ahrefs already has a very good tool for this - but I don't really want to have to pay the $79 a month if moz has something similar? I know it has the OSE. Can I do batch analysis in this? Thanks
Link Explorer | | SWD.Advertising1 -
Rogerbot and Dotbot blocked by WP Engine hosting
We recently discovered a problem with our MOZ account which led to checking our host's settings. Turns out that WP Engine (who we love to death) automatically BLOCK Rogerbot and Dotbot from crawling sites they host. What? Yeah exactly expect I was cursing a little too. So we went through the steps of getting that sorted one bot at a time but a week on and we're still getting 403 returns via OSE. This is more of a discussion than a question expect what I would like to see is a force crawl button so that we can test that we're no longer serving a 403 error from our host MOZ. I thought WP Engine were huge and I'm surprised this has not come up before but there's no info on it anywhere. Is there a way to force a mozbots crawl??
Link Explorer | | wearehappymedia0 -
Moz crawling bot
Hi guys, in OpenSiteExplorer -> Top Pages, there are no page titles displayed in a raport for certain domain, and "HTTP Status" column shows: "Blocked by robots.txt". I tried to find out what the ID of Moz crawling bot is, and on this page: http://moz.com/community/q/seomoz-spider-bot-details someone says it's: Mozilla/5.0 (compatible; rogerBot/1.0; http://www.seomoz.org/dp/rogerbot). However, my robots.txt doesn't have such entry. Take a look: Automatically banned scanners and crawlers section User-agent: 008 Disallow: / user-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: metajobbot Disallow: / User-agent: Exabot Disallow: / User-agent: Ezooms Disallow: / User-agent: fyberspider Disallow: / User-agent: dotbot Disallow: / User-agent: MojeekBot Disallow: / Section end What could be the problem here, then? Why does the Moz bot think I'm blocking it?
Link Explorer | | superseopl0