Error Message on Moz Crawler
-
Hi all,
Just ran into this issue, when analysing this site. Just got this message when using MOZ "Page Optimisation Error". Anyone know why?
It seems to be working fine on other SEO analyser tools.
Website is: www.sbpcreativemedia.com.au
Thanks in advance!
-
Hi Jo,
Thanks for your quick reply and investigation. I'l tell our developer to have a look and get back to you.
Thanks again
-
Hi there,
Jo again from the Moz help team.
I'm afraid we're still getting a 520 error when we try to access your robots.txt.
In oder to investigate this further I wonder if you could please ask your website administrator or host for a copy of your server logs so we can see how your server is responding to rogerbot.
Please send your server logs to help@moz.com.
Cheers!
Jo -
Hi there,
Thanks for reaching out!
It looks like we encountered a 520 error when we tried to crawl your site, if you check the Site Crawl tab in your Moz Pro Campaign you'll see that we were not able to access your robots.txt at the time of the crawl.
I'm going to kick off a recrawl at my end to see if this was an intermittent error and we can go from there.
Thanks for bearing with me!
Jo
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Google redirect backlink created. Do I have to ping this for Moz to recognize it?
Google redirect backlink created. Do I have to ping this for Moz to recognize it?
Link Explorer | | dlwnsh05100 -
Does Moz register backlinks from Twitter/Facebook/LinkedIn?
I've noticed that on sites with decent social presence and regular content posts that Moz isn't showing/recording any inbound links from Twitter, Facebook or LinkedIn. Posts are regularly shared via these three channels but no inbound links ever seem to show up. Does Moz not record such inbound links, or are they all disguised using JavaScript or some other trick?
Link Explorer | | JCN-SBWD0 -
Why are recently deleted pages still appearing in the latest MOZ crawl?
Newbie, so please forgive!! OK, so I'm doing my 1st site optimization. It is reporting errors from pages that were deleted a couple of days ago. And I JUST signed up today. Where is this info coming from? Thanks, Billy
Link Explorer | | NewSEOguy0 -
Moz Toolbar "Get Keyword Difficulty"
New Moz Pro user here, and I've a question about the green "Get Keyword Difficulty" button that shows up to the right of the Google Search Keyword Term Input field after a successful search. Clicking on this seems to have no effect for me what-so-ever. Doesn't take me to the keyword tool, download a report, or add anything to the one screen link analyses in the search results. In short, i'm not sure how this tool is supposed to function. I'm using the latest version of Google Chrome (Version 52.0.2743.60 beta-m (64-bit)) on a Windows 10 machine.
Link Explorer | | bvkinsight1 -
Does using Sucuri block Moz?
I am using Opensite explorer on my site which uses Sucuri and it shows 0 for everything. Does Sucuri stop MOZ from reading the link? I also suspect that using Sucuri has made my SEO suffer because the first page is always saying "redirecting" . Anyone with experience to this? Thanks
Link Explorer | | seoprojecter0 -
Error message coming up for Open Site Explorer
When in Open Site Explorer there seems to be an error getting the data for http://vagabondtoursofireland.ie/ or www.vagabondtoursofireland.ie I have used this with other websites and have never had a problem. Thanks.
Link Explorer | | Johnny_AppleSeed0 -
Remove Meta Description Errors
When Moz shows pages that are 404's you are able to remove them after the issue is fixed. Is there a way to do this for missing Meta Descriptions? It shows that numerous pages are missing them, but when I go look, it's already been corrected and it is still showing months later.
Link Explorer | | seomozinator0 -
Clicking on "Filter" on "Just discovered"tab errors out
IF you click on the "fiter" button on the "just discovered" tab in OSE, page returns message "no links found." This is weird because that message displays even when you didn't actually filter for anything, but just clicked on the button.
Link Explorer | | ALLee0