"Our crawler was not able to access the robots.txt file on your site."
-
Hi Mozzers!
I've received an error message saying the site can't be crawled because Moz is unable to access the robots.txt. I've spoken to the webmaster and he can't understand why the robot.txt can't be accessed as this seems to be fine:
https://k3syspro.com/robots.txt
and Google isn't flagging anything up to us.
Does anyone know why this may be?
Thanks,
Matthew
-
Hey K3,
Looks like you have bigger fish to fry, your host domain is throwing a 503 server error. No server = no content = no robots.txt will be able to be found until that is resolved. Error still happening as of this post: http://downforeveryoneorjustme.com/https://k3syspro.com
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Solved Site DA and PA
Hi, I'm facing an issue regarding Moz Site Explorer. When I enter my blog for check it's DA and PA. All Moz do is keep loading. I have to reload the page for two or more times for checking DA and PA. Kindly let me know is there any issue with my account. Regards.
Product Support | | BuiLungTen0 -
Campaign Tracking on Site with different CMS systems
Hello, We have a lot of international tracking issues. our site is www.avepoint.com/de our blog site is www.avepoint.com/blog/de The main site is hosted on Craft CMS, the other is on WordPress. Right now I am not seeing any rankings for blogs on our WordPress site but am seeing that I am winning words in Germany when I use google ad preview. I see good ranking stats for the main site. I am not sure why I cant see any data for the blog site. Any ideas what might be wrong or how I can fix it? Thanks, Amanda
Product Support | | AvePoint1 -
If I cancel, will I lose all my historical data & be able to access it?
I would like to still be able to view my historical data once I cancel. Will I still have access to it? Thanks.
Product Support | | StudioX1 -
Still no invite to site crawl beta! Why bother?
Well, I was informed that I was en-queue to be invited to the Moz Site Crawl v2. I have several client sites making use of SNI b/c, well... CDN's. What is the point of telling me I may receive an invitation shortly, then hearing nothing back and not being able to crawl their sites... this makes this service 100% useless as I can simply use a couple of different tools (free) to perform the same tasks... don't get me wrong... I would rather use Moz and this is not intended to flame the service as I think it could be great... if only it worked. I cannot justify the lack of response, nor the lack of service (what we intended to use here) for the price. It seems like this is simply a waiting game wherein Moz expects me to pay for this service and THEN I will receive my invite? Is it at all possible that anyone can look into this and/or my invite status. If I cannot sample these features before long, you've lost a solid potential client. (Not my loss)
Product Support | | jmsdonline0 -
Moz having a few issues with their site?
I've seemed to have a load of issues as of late. Just small graphical things but still enough to make me concerned. 1. https://moz.com/community/users/4207879 being noindex (however it seems to other users an external tools work) (image proof: https://i.gyazo.com/2e77c94ffd068718e9e149e8afef1e44.png ) 2. No mozpoints: https://gyazo.com/9e0777af3ebbdb6ad58a395bafe28a52 3. I'm a staff member? https://i.gyazo.com/5d7b156c13fa1d0bb6c2e0af3467423f.png 4. Trying to respond when logged out: https://i.gyazo.com/9f5fe8efd372920391a9a54178561e0b.png (not really a bug, however could be a better experience) These have all been sent via support, just wondered if it was just me having issues? Seems i'm staff on this one too: https://i.gyazo.com/6f1bc6372180f4f9f1cb1c7d6f6d941c.png
Product Support | | ThomasHarvey0 -
My campaigns are all missing and can't access archives
"Oops! Try refreshing the page, if that doesn't work, please click here to contact our help team." Yu0PY7g
Product Support | | matthewjharris0 -
Deleting a site
If we have a 3 of 5 of our "active site" allocation currently used, and then delete one, would we then only have 2 of 5 sites active sites used? Or would the previously used active site still count against our allocation?
Product Support | | lincolndigitalgroup1 -
Why Moz Analytics says that my site had a 13% traffic increase and Moz Pro says that the same site had 3% decrease on traffic?
Every Tuesday The first thing I do in the morning is check my updates on my Moz Campaigns... Today the numbers just don't make sense... How come Moz Analytics and Moz Pro are showing different numbers? Does any one have the same problem? Which one should i trust?
Product Support | | Felip30