On-Page Grader supporting HTTPS?
-
Hi there,
I am getting the error "Sorry, but this URL is inaccessible" on the Moz On-Page Grader. I have tested with multiple URL's but any that link to my site give the error. I have noticed my site's URL's redirect to https so my question is..is the on-page grader in-compatible with https?
Cheers!
Ross -
Oh good! I'm glad you were able to find the source!
We actually use a set of dynamic IPs, so there's not a range that I'd be able to provide. I'm afraid the best things I could suggest would be to ask them to whitelist our user agents, dotbot and rogerbot.
-
Thanks Jordan, it didn't make a difference but what I found was that my hosting company was blocking Amazon Web Services. They said they need a range of IP's from the cloud service that Moz uses to unblock, is there anyway you can advise me on what these are and is Amazon the cloud service that Moz uses?
Cheers!
-
I would expect that to take care of the issue
-
I've changed it too:
User-agent: rogerbot
Allow: /
Would this let Moz crawl the site?
-
Hmm I thought that too! It's strange though because my site is being indexed on Google and Moz is able to crawl it for other features. When I run the robots test in Google Webmaster Tools, the one where you run a test to see if URL's are blocked and you pick a bot e.g Googlebot...it says everything is working ok and it is allowed? Wouldn't that not be the case if bots were blocked from crawling the site?
-
Ah, yep, that would do it!
That configuration is currently blocking every bot known to man from accessing every portion of your site. Here's an awesome resource to help with robots.txt setup: http://www.robotstxt.org/robotstxt.html
If you were looking to allow all robots to access all pages on your site, then this command would do the trick:
User-agent: *
Disallow:
(Without the blank line between commands. Q&A formatting be damned.
)
-
Hi Jordan,
Thanks a million for your response! I am still having the same issue..my robots.txt is as follows:
User-agent: *
Disallow: /Would this be blocking those bots? I know this blocks bots from accessing ALL content, but does it block all bots from accessing my site in general? Should I be changing it and if so, what would you recommend I change to allow for optimal crawling?
Cheers and thanks for taking the time to respond!
-
Hi Ross!
On-Page Grader should definitely function for https sites, in general. For example, https://moz.com looks to be working just fine.If you're getting that response from On-Page Grader, it's usually related to some sort of blockage. I'd recommend checking through your robots.txt to make sure that rogerbot and dotbot aren't being blocked, that your SSL is all looking good, and that the site isn't blocking Amazon Web Services (AWS).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Cant figture out why On-Page Grader is not recognizing the heading tag text
Hi all, I'm using the On-Page Grader tool to optimize some of our pages: https://analytics.moz.com/pro/research/page-grader?keyword=Russian Immigration Lawyers in Sacramento&url=https%3A%2F%2Fwww.russianlawyers.us%2Fus%2Fcalifornia%2Fsacramento-immigration One of the suggestions is "Optimal Use of Keywords in Header Tags". They keyword is "Russian Immigration Lawyers in Sacramento" and we do have it in an tag on the page (located in the right sidebar). The tool doesnt seem to catch that though. Can someone help me please? Thanks
Moz Bar | | heritageweb1 -
Title tag not registering on page optimization
I added a link to the "page optimization" section at moz. When I submit the url to be reviewed (click "optimize") it doesn't find the title tag, although it is definitely there e.g this page
Moz Bar | | digitalalchemy
http://naamanewman.co.il/photosGalleryID.aspx?id=34 Anybody as any Idea why is that? Maybe the tag placement on the DOM (it's not directly under the opening head tag).0 -
On-page Grader API?
Hi guys, I have a massive list of keywords i want to optimise against a specific URL. I'm checking them manually with the MOZ on-page grader to determine if the keyword is optimised for the URL (Grade A score). I was wondering if there is a way to pull the scores automatically for each URL with the MOZ api? Or does anyone know of any tools which can automate this process? Cheers, Chris
Moz Bar | | jayoliverwright1 -
Crawl Diagnostics: How many pages (deep) will it crawl for dup content
Does anyone know how deep the crawl diagnostics will crawl when searching for dup content? Will it crawl the entire site, or will it only crawl "x" amount of pages? Thanks!
Moz Bar | | tdawson090 -
I'm getting a Crawl error 605 Page Banned by robots.txt, X-Robots-Tag HTTP Header, or Meta Robots Tag
The website is www.bigbluem.com and is a wordpress site. I'm getting the following error: 605 Page Banned by robots.txt, X-Robots-Tag HTTP Header, or Meta Robots Tag But what is weird is the domain it lists below that is http://None/BigBlueM.com Any advice?
Moz Bar | | TumbleweedPDX1 -
Should I be getting an 'A' Grade for basic words in a page title?
It seems as long as a word in the page title matches a word(s) within the page content you will get an 'A' grade. Should I be replacing these keywords with higher monthly searches and lower difficulty? It appears deceptive when you test a new website and all the pages get an 'A' for a word as basic as 'about.' Please advise.
Moz Bar | | Joseph.Lusso0 -
I have been unable to use the export button on any of the Moz pages.
Every time I click the export button on the upper right portion of the page, it says "preparing to export", but either nothing is exported or a blank document is downloaded. I was specifically working with the Fresh Web Explorer but have noticed this on all pages. Is anyone getting this export function to work?
Moz Bar | | Manseo0 -
On Page Grader Question
Hi there, I have just used the On Page Grader on this page: -removed- and checked the grade for the following keywords together: wedding venues bath The On Page Grader has found 15 instances on the page for this keyword. When i view the page source and ctrl-f and search for ''wedding venues bath'', it only finds 8. Is there an issue with the On Page Grader atm?
Moz Bar | | jennie.evans0