Onpage grader says site unreachable
-
It is possible the crawler is caught in the firewall. Any idea what I need to have whitelisted?
-
Thanks for the update! So glad it's working now.
-
Just to update for people that see this question in the future. The problem was caused by the lack of intermediate certificate. Everything is now working.
-
Just to add, I managed to run a site crawl (the one with the downloadable csv file) so clearly it is just related to the on-page grader.
Also, rather strangely other sites on the VPS work fine (http).
Therefore I am thinking more and more that it is an SSL intermediate certificate issue.
-
Yeh, that answer was not very helpful, although it contained useful information.
My working theory is that as I just transferred the site to one of my VPS that the SSL doesn't have a valid intermediate certificate. I will have a closer look at resolving this tomorrow.
It probably didn't help that I was not accurate with the error message which states that "sorry but that url is inaccessable".
-
Have you considered going through your server and/or firewall logs to find out the root cause of the issue? Your host should be able to help you there, even without any IP's. Just run a crawl, and tell them approximately what time you ran it - that should be enough for them to start analyzing the issue.
The first question to find an answer to is what is blocking the crawler, followed by how is it blocking the crawler and finally, why is it blocking the crawler.
Once you find an answer to those questions, it will be vastly easier to help you find a solution.
-
Well, my host cannot check without IP's and from what I read Moz doesn't give out IPs as they are dynamic.
I guess that leaves me stuck unable to use this service.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
That URL is inaccessible Moz grader?
Hi all, I'm having some issues getting my site graded www.balihaiphoto.com + Kauai wedding photographer with On Page grader, where as when I enter another photographer example www.jmoellerphoto.com and getting results. Is there any reason this is going on that I can correct? Many thanks for any help all! -Jon
Moz Bar | | Jon_Gibb0 -
Why RogerBot can't crawl site https://unplag.com
Hello Please help me to solve the problem. The on-page grader and Crawl Test are not working for Unplag.com website. Both said that they can't access the url. Yes, I've tried different variants like unplag.com, http://unplag.com One more thing - RogerBot was disallowed in robots.txt file. I deleted it from the file a week ago so maybe moz index haven't been renewed.
Moz Bar | | Targeras0 -
How do you block keywords in On-Page Grader for certain URLs?
For the on-page grader, I rank A's for 9 keywords. I struggle with F's I have because it is searching keywords on pages that are not supposed to be searched. For example, I have a "bracelets" page, so I didn't optimize it for "rings", so I got an F. However, it graded me an A for the bracelets keyword, which is great. To be sure I am correct, each page should have it's own keyword, such as bracelet. So why is the grader checking my "Bracelets" page for "Rings"? Maybe there is something I am missing. Just trying to see why this happening.
Moz Bar | | tiffany11030 -
Where is the old seomoz.org onpage analyzer?
I am just getting back to Moz following an update. Before seomoz.org became moz.com. there used to be a tool that did some onpage analysis that I can't seem to find anymore (searched all day). It did things like: Duplicate Title Duplicate content Broken links etc... Would someone please be so kind as to provide me the link to this tool? Or if it is no longer available, a 3rd party tool? Kind regards, Kurt
Moz Bar | | Kurtyj0 -
On Page Grader Question
Hi there, I have just used the On Page Grader on this page: -removed- and checked the grade for the following keywords together: wedding venues bath The On Page Grader has found 15 instances on the page for this keyword. When i view the page source and ctrl-f and search for ''wedding venues bath'', it only finds 8. Is there an issue with the On Page Grader atm?
Moz Bar | | jennie.evans0 -
"Sorry! We weren't able to find that page when we crawled your site." Please help!
Can someone please explain whey I am getting this error for this link "http://lensoutloud.com/san-antonio-real-estate-photography/" when I attempt to perform an on page SEO grading? The link is indexed and ranking very well but for some reason Moz says it can't find the page when it crawled my site. This has also happened when I attempt to grade other pages on my site. Thanks in advance!
Moz Bar | | AndreGant0 -
Open Site Explorer Problems
I've been checking open site explorer for months now. It doesn't show any changes in the number of root domain links to any of my pages, even though webmaster tools shows a substantial increase in root domain links for each of these urls. Open Site Explorer doesn't seem to be updating. According to Moz, my site is regularly indexed by Moz. But the numbers don't change. I've tested this on a few other sites as well with the same results. How do I get OSE to update the numbers for a particular website?
Moz Bar | | zagginc0 -
Blocked Production Site from Search Engines - How to get it Crawled by Moz Crawler
I have an 'under development' site hosted, (which is an exact replica of live site as working on to add new functionalities & modules) - but its password protected, excluded from robots.txt (Disallow) & also marked noindex on all pages in the index - so that Googlebot & other Search Engines can not crawl the site At present the development work is almost 95% completed., Now - feel like to crawl the site through SEOMOZ Roger Bot - to know the errors and all indexed urls by Rogerbot. What's the best way to get Moz Bot crawl the site - but simultaneously continue it blocking its access to Search Engines I have gone through - https://support.google.com/webmasters/answer/93708?hl=en, it says a) Save it in a password-protected directory. Googlebot and other spiders won't be able to access the content- But this way Moz will also not be able to crawl the site b) Use a robots.txt to control access to files and directories on your server - However it also says - It's important to note that even if you use a robots.txt file to block spiders from crawling content on your site, Google could discover it in other ways and add it to our index. c) Use a noindex meta tag to prevent content from appearing in our search results - It also says that a link to the page can still appear in their search results. Because we have to crawl your page in order to see the noindex tag, there's a small chance that Googlebot won't see and respect the noindex meta tag Password Protected thus seems the best way to continue blocking. However, continuing with it will also block Moz bot to crawl the site. Any suggestions Thanks
Moz Bar | | Modi0