"Our crawler was not able to access the robots.txt file on your site."
-
Hi Mozzers!
I've received an error message saying the site can't be crawled because Moz is unable to access the robots.txt. I've spoken to the webmaster and he can't understand why the robot.txt can't be accessed as this seems to be fine:
https://k3syspro.com/robots.txt
and Google isn't flagging anything up to us.
Does anyone know why this may be?
Thanks,
Matthew
-
Hey K3,
Looks like you have bigger fish to fry, your host domain is throwing a 503 server error. No server = no content = no robots.txt will be able to be found until that is resolved. Error still happening as of this post: http://downforeveryoneorjustme.com/https://k3syspro.com
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Merging two Sites into One - how is Final Domain Authority Calculated?
Hi, If we merge two sites say, one with DA 35 and another 20 what will be resulting DA of the merged site? Secondly, will the result vary based on which Domain is kept and which one is 301ed? ps :- all content is transferred from one to another using 301. Regards,
Product Support | | Praveenshah10 -
Moz has stopped crawling my site
Hello, We have been using Moz Pro for over a year on our site and in the last month noticed that our site is not being crawled anymore. I took a look in Google Search Console, and everything seems to be fine there, so I think it is just the Moz tool that is not working. Has anyone else experienced this? Are there any tips for troubleshooting it? Thank you, Adam
Product Support | | cwells0 -
What is the difference between the "Crawl Issues" report and the "Crawl Test" report?
I've downloaded the CSV of the Crawl Diagnositcs report (which downloads as the "Crawl Issues" report) and the CSV from the Crawl Test Report, and pulled out the pages for a specific subdomain. The Crawl Test report gave me about 150 pages, where the Crawl Issues report gave 500 pages. Why would there be that difference in results? I've checked for duplicate URLs and there are none within the Crawl Issues report.
Product Support | | SBowen-Jive0 -
I plan to have multiple sites/compaigns. My Question: Is there a way to set up a limited account that one client would be able to view just their campaign?
I don't want a client to be able to see all of our other campaigns, just theirs. Is there a way to set this up?
Product Support | | darylgochnauer0 -
Is there a way to alphabetize the "Manage your Campaigns" screen?
We just went up to 100 campaigns and can't seem to find a way to alphabetize our list of campaigns. Anybody have a fix for sorting those alphabetically?
Product Support | | BKraff0 -
Giving others like employees admin access ?
Hi I have my master logins for Moz but just wandering if i can grant a degree of access to employees via their own logins (just 1 person at this stage) since i dont want to share mine (since use for other stuff too) and ideally dont want them to have full admin permission (such as being able to delete campaigns) ? Cheers Dan
Product Support | | Dan-Lawrence0 -
Cannot Access Moz Analytics
I've been trying to access Moz Analytics for over a month but have continued to see this error message: http://screencast.com/t/GMnN6l9WEI tried on all browsers and cleared my cache. The login works, because I am able to access it on other computers but not on my primary computer. This leads me to believe that Moz' servers are blocking out my computer's IP address for whatever reason.I've tried emailing the help team and calling but have not gotten any sort of response so far. Anyone have a solution?
Product Support | | EvolveDigitalLabs1 -
Giving access to a new user
We are looking to give access to a different user in our org, but when they try to log in on a different device, it's not working. The only device that can log in is mine. Please advise...
Product Support | | linkupSEO0