Error Message on Moz Crawler
-
Hi all,
Just ran into this issue, when analysing this site. Just got this message when using MOZ "Page Optimisation Error". Anyone know why?
It seems to be working fine on other SEO analyser tools.
Website is: www.sbpcreativemedia.com.au
Thanks in advance!
-
Hi Jo,
Thanks for your quick reply and investigation. I'l tell our developer to have a look and get back to you.
Thanks again
-
Hi there,
Jo again from the Moz help team.
I'm afraid we're still getting a 520 error when we try to access your robots.txt.
In oder to investigate this further I wonder if you could please ask your website administrator or host for a copy of your server logs so we can see how your server is responding to rogerbot.
Please send your server logs to help@moz.com.
Cheers!
Jo -
Hi there,
Thanks for reaching out!
It looks like we encountered a 520 error when we tried to crawl your site, if you check the Site Crawl tab in your Moz Pro Campaign you'll see that we were not able to access your robots.txt at the time of the crawl.
I'm going to kick off a recrawl at my end to see if this was an intermittent error and we can go from there.
Thanks for bearing with me!
Jo
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Hello There I have a site the problem with this site is I have taken countless backlinks but it is not reflecting on Moz. Is there any way to help Moz find my links?
Hello There I have a site health related..the problem with this site is I have taken countless backlinks but it is not reflecting on Moz. Is there any way to help Moz find my links? herpescurecare.com
Link Explorer | | thelancethealth0 -
What is difference between Moz data than ahrefs?
hi, On ahrefs it's showing me that my web Fit Food has 1.2k backlinks and 140 referring domain. while on Moz it's totally different stats which making me confuse to understand. So is Domain rating is different than Domain Authority?
Link Explorer | | SophiaRPereira1 -
Why is there difference in keywords of moz and ahrefs
Hello, my welding helmets website Helmet Adviser is about reviews and is causing me confusion. When I check my site keywords in Moz it shows lesser keywords and when I check in ahrefs it shows more. Same is for backlinks. But Moz keywords research is very authentic and i want to rely on it for keywords and backlinks too. Please elaborate for me why is there diff between Moz and ahref, so I can better utilize Moz by understanding what is going on in the background.
Link Explorer | | ericcampbell10 -
How to Fix Repeating 404 Error on Blog
I've been getting this same 404 Error for a ton of pages on my blog (blog.twowayradiosfor.com) out of nowhere and I can't figure out how to fix it. I have about 500 of them that are experiencing the same issue (as shown in the image I've attached/linked to). It has the correct link, then the part that gets flagged as 404 adds a /TwoWayRadiosFor.com at the end, which is apparently the issue. Is there a reason these have just now appeared even though the blog posts are from years ago? Is there an easy way to fix it? Thanks, Sawyer dF6mUJQ
Link Explorer | | AllChargedUp0 -
612 : Page banned by error response for robots.txt
Hi all,
Link Explorer | | ME5OTU
I ran a crawl on my site https://www.drbillsukala.com.au and received the following error "612 : Page banned by error response for robots.txt." Before anyone mentions it, yes, I have been through all the other threads but they did not help me resolve this issue. I am able to view my robots.txt file in a browser https://www.drbillsukala.com.au/robots.txt.
The permissions are set to 644 on the robots.txt file so it should be accessible
My Google Search Console does not show any issues with my robots.txt file
I am running my site through StackPath CDN but I'm not inclined to think that's the culprit One thing I did find odd is that even though I put in my website with https protocol (I double checked), on the Moz spreadsheet it listed my site with http protocol. I'd welcome any feedback you might have. Thanks in advance for your help.
Kind regards0 -
Does using Sucuri block Moz?
I am using Opensite explorer on my site which uses Sucuri and it shows 0 for everything. Does Sucuri stop MOZ from reading the link? I also suspect that using Sucuri has made my SEO suffer because the first page is always saying "redirecting" . Anyone with experience to this? Thanks
Link Explorer | | seoprojecter0 -
Error message coming up for Open Site Explorer
When in Open Site Explorer there seems to be an error getting the data for http://vagabondtoursofireland.ie/ or www.vagabondtoursofireland.ie I have used this with other websites and have never had a problem. Thanks.
Link Explorer | | Johnny_AppleSeed0 -
Why moz pro detects inexistent links?
I have a campaign in moz pro to my personal webpage for testing purposes and also a bit of learning. But i have a question: On link -> Link analysis i can see this: http://maqui.darkbolt.net/project/chat/index.php 404http://maqui.darkbolt.net/project/docs/index.php 404http://maqui.darkbolt.net/project/down/index.php 404http://maqui.darkbolt.net/project/foto/index.php 404http://maqui.darkbolt.net/project/news/index.php?news=1 404http://maqui.darkbolt.net/project/project/index.php 404http://maqui.darkbolt.net/project/ro/index.php 404http://maqui.darkbolt.net/project/who/index.php 404Obviously all these address doesn't exist. There are links on the page project/index.php linking to, for example, /chat/index.php.How can i resolve this problem on the stats? There's something bad really on the page? As i can see all links on the page are working properly.
Link Explorer | | Er_Maqui0