On-Page Grader supporting HTTPS?
-
Hi there,
I am getting the error "Sorry, but this URL is inaccessible" on the Moz On-Page Grader. I have tested with multiple URL's but any that link to my site give the error. I have noticed my site's URL's redirect to https so my question is..is the on-page grader in-compatible with https?
Cheers!
Ross -
Oh good! I'm glad you were able to find the source!
We actually use a set of dynamic IPs, so there's not a range that I'd be able to provide. I'm afraid the best things I could suggest would be to ask them to whitelist our user agents, dotbot and rogerbot.
-
Thanks Jordan, it didn't make a difference but what I found was that my hosting company was blocking Amazon Web Services. They said they need a range of IP's from the cloud service that Moz uses to unblock, is there anyway you can advise me on what these are and is Amazon the cloud service that Moz uses?
Cheers!
-
I would expect that to take care of the issue
-
I've changed it too:
User-agent: rogerbot
Allow: /
Would this let Moz crawl the site?
-
Hmm I thought that too! It's strange though because my site is being indexed on Google and Moz is able to crawl it for other features. When I run the robots test in Google Webmaster Tools, the one where you run a test to see if URL's are blocked and you pick a bot e.g Googlebot...it says everything is working ok and it is allowed? Wouldn't that not be the case if bots were blocked from crawling the site?
-
Ah, yep, that would do it!
That configuration is currently blocking every bot known to man from accessing every portion of your site. Here's an awesome resource to help with robots.txt setup: http://www.robotstxt.org/robotstxt.html
If you were looking to allow all robots to access all pages on your site, then this command would do the trick:
User-agent: *
Disallow:
(Without the blank line between commands. Q&A formatting be damned.
)
-
Hi Jordan,
Thanks a million for your response! I am still having the same issue..my robots.txt is as follows:
User-agent: *
Disallow: /Would this be blocking those bots? I know this blocks bots from accessing ALL content, but does it block all bots from accessing my site in general? Should I be changing it and if so, what would you recommend I change to allow for optimal crawling?
Cheers and thanks for taking the time to respond!
-
Hi Ross!
On-Page Grader should definitely function for https sites, in general. For example, https://moz.com looks to be working just fine.If you're getting that response from On-Page Grader, it's usually related to some sort of blockage. I'd recommend checking through your robots.txt to make sure that rogerbot and dotbot aren't being blocked, that your SSL is all looking good, and that the site isn't blocking Amazon Web Services (AWS).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Site Crawl 1-page 301 status error but httpstatus.io says its 403
I am trying to run a site crawl for my website and MOZ is only resulting in 1 page crawled with the home page URL Status Code of 301. However when I run it in httpstatus.io it is giving me a 403 status error. Im curious as to why MOZ is saying its a 301 and httpstatus.io is saying 403. Is there anything I can do in MOZ first to get the site crawled before asking my developers to look into the 403 error?
Moz Bar | | JohnConover0 -
MozBar: Page Title (and other data) inconsistent with HTML
In using the MozBar Chrome extension, I have noticed that the data about a page that MozBar displays is sometimes inconsistent with the "head" tag in the HTML of the page. Am I misunderstanding where MozBar is getting the data it is displaying? Other SEO extensions like "META SEO inspector"do not display these inconsistencies. EupH5sG
Moz Bar | | clayjones0 -
In MozBar Page Analysis under General Attributes Country is empty or wrong
Some of our clients sites have a top level domain for Mexico, but in the Mozbar they doesn't show any country, is this related to a known bug? https://www.edacom.mx/ https://www.dropbox.com/s/a8jgr7ztk1im15k/Captura de pantalla 2019-08-15 12.41.10.png?dl=0 https://www.cliento.mx/ https://www.dropbox.com/s/a8jgr7ztk1im15k/Captura de pantalla 2019-08-15 12.41.10.png?dl=0 In the search console: "International Targeting report" the target is Ok to Mexico.
Moz Bar | | Andrea_Ugalde1 -
Keyword used 2389 times in page
in the "on page grader" tool I get that the keyword appears 2389 times. I'ave searched for it in the developer console, thinking it might be due to invalid HTML - but the number it's appearance is no near to 2389. Can any one help me figure out why is this so? the page is http://naamanewman.co.il/photosGalleryID.aspx?id=34
Moz Bar | | digitalalchemy
keyword "שמלות כלה נפוחות" (hebrew) QDQW4xw.png0 -
Moz crawler only crawls one page?!
Hello there, I'm using Moz for a while and I'm very pleased with the tool and community. But for the first time I encountered a problem. We are trying to run a crawler for a client's website but only one page (only the homepage) was crawled. We tried to do a test on a more detailed level (maybe there is something wrong with the homepage). My campaign test's crawl came back for the Producten folder (level deeper than homepage), and it was also only a 1 page crawl with a 200 status. I did look at the robots.txt file now, and it is very restrictive, but there is nothing that I can clearly see that would explain why the crawl isn't working. Hopefully someone can point us at the right direction. Thanks in advance, Jeremy
Moz Bar | | mediaxplain.nl0 -
Keyword used 1448 times ? for a Chinese page
Hi, I tested my page grade here : https://moz.com/researchtools/on_page_grader_reports/1269197 Keyword : "專案管理軟體" , which means "Project Management Software" in Traditional Chinese. URL: http://helpmecloud.com/clarizen-introduction.html But the On Page Grader told me "We found this keyword used 1448 times." I think the result is wrong, I guess you calculated all Chinese letters separately. Am I right ? How can I get a correct grade for my page ? Thansk for help! William
Moz Bar | | Helpmecloud0 -
I have been unable to use the export button on any of the Moz pages.
Every time I click the export button on the upper right portion of the page, it says "preparing to export", but either nothing is exported or a blank document is downloaded. I was specifically working with the Fresh Web Explorer but have noticed this on all pages. Is anyone getting this export function to work?
Moz Bar | | Manseo0 -
On Page Grader Question
Hi there, I have just used the On Page Grader on this page: -removed- and checked the grade for the following keywords together: wedding venues bath The On Page Grader has found 15 instances on the page for this keyword. When i view the page source and ctrl-f and search for ''wedding venues bath'', it only finds 8. Is there an issue with the On Page Grader atm?
Moz Bar | | jennie.evans0