On-Page Grader supporting HTTPS?
-
Hi there,
I am getting the error "Sorry, but this URL is inaccessible" on the Moz On-Page Grader. I have tested with multiple URL's but any that link to my site give the error. I have noticed my site's URL's redirect to https so my question is..is the on-page grader in-compatible with https?
Cheers!
Ross -
Oh good! I'm glad you were able to find the source!
We actually use a set of dynamic IPs, so there's not a range that I'd be able to provide. I'm afraid the best things I could suggest would be to ask them to whitelist our user agents, dotbot and rogerbot.
-
Thanks Jordan, it didn't make a difference but what I found was that my hosting company was blocking Amazon Web Services. They said they need a range of IP's from the cloud service that Moz uses to unblock, is there anyway you can advise me on what these are and is Amazon the cloud service that Moz uses?
Cheers!
-
I would expect that to take care of the issue
-
I've changed it too:
User-agent: rogerbot
Allow: /
Would this let Moz crawl the site?
-
Hmm I thought that too! It's strange though because my site is being indexed on Google and Moz is able to crawl it for other features. When I run the robots test in Google Webmaster Tools, the one where you run a test to see if URL's are blocked and you pick a bot e.g Googlebot...it says everything is working ok and it is allowed? Wouldn't that not be the case if bots were blocked from crawling the site?
-
Ah, yep, that would do it!
That configuration is currently blocking every bot known to man from accessing every portion of your site. Here's an awesome resource to help with robots.txt setup: http://www.robotstxt.org/robotstxt.html
If you were looking to allow all robots to access all pages on your site, then this command would do the trick:
User-agent: *
Disallow:
(Without the blank line between commands. Q&A formatting be damned. )
-
Hi Jordan,
Thanks a million for your response! I am still having the same issue..my robots.txt is as follows:
User-agent: *
Disallow: /Would this be blocking those bots? I know this blocks bots from accessing ALL content, but does it block all bots from accessing my site in general? Should I be changing it and if so, what would you recommend I change to allow for optimal crawling?
Cheers and thanks for taking the time to respond!
-
Hi Ross!
On-Page Grader should definitely function for https sites, in general. For example, https://moz.com looks to be working just fine.If you're getting that response from On-Page Grader, it's usually related to some sort of blockage. I'd recommend checking through your robots.txt to make sure that rogerbot and dotbot aren't being blocked, that your SSL is all looking good, and that the site isn't blocking Amazon Web Services (AWS).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why can I see 404 pages in Google Analytics but nothing in the On-Demand Crawl?
Hello, I'm looking at some Google Analytics data for a website and can see a few 'Page not found's among the Page Titles, looking like these are 404 errors. To get a full list of what's 404-ing so I can get these redirected, the Moz on-demand crawl of the website has come back with no major errors and just a few metadata ones. Does anyone know any potential reasons why the audit has drawn a blank, and is there another way to get a comprehensive list of 404s, as I'm aware the Google Analytics data may not be covering all of them. Thanks very much Becky
Moz Bar | | becky.jenkins0 -
Keyword used 2389 times in page
in the "on page grader" tool I get that the keyword appears 2389 times. I'ave searched for it in the developer console, thinking it might be due to invalid HTML - but the number it's appearance is no near to 2389. Can any one help me figure out why is this so? the page is http://naamanewman.co.il/photosGalleryID.aspx?id=34
Moz Bar | | digitalalchemy
keyword "שמלות כלה נפוחות" (hebrew) QDQW4xw.png0 -
Onpage Grader not Finding Keyword in URL
I've noticed that the Onpage Grader is not including my keyword in the URL when the keyword is in the domain. If I grade an inner page and the keyword is in the sub-directory, it finds it. Is this intentional? If so, why does the grader not include my keyword in the domain as Keyword in the URL?
Moz Bar | | Dino640 -
Moz's on-page grader
Hello, I am having an issue with Moz's on-page grader. Grading the page, http://www.babyklar.dk/tigerspring/26-ugers-springet.html for the keyword 'Tigerspring 26 uger' I am receiving the error message: 'Exact keyword is used in page title' - tagging it as a highly important but easy fix. But I only have the words "Tigerspring 26 uger" in the title, so how can this not grade as Exact keyword? Is there somthing wrong with the system? Or is it me? Thanks very much. Best regards
Moz Bar | | Babyklar
Martin0 -
Measure the impact of SEO on a relaunch of a page
we have just re-launched one of the pages of our website with fresh content etc. Would like to know how we can use Moz to measure the changes and impact of the re-launch from an SEO standpoint.
Moz Bar | | ULaw0 -
Www.site.com linking to pages www10.site.com
The root domain of the website in question is www.site.com but all subpages are on the subdomain www10.site.com (I'm pretty sure it's a subdomain, at least, used for load balancing?). A funny thing happens on this site with the moz toolbar. I visit a subpage, www10.site.com/articles/articletopic1 That page has a lot of links on it, all of them visibly going to the subdomain www10.site.com. However, the moz toolbar shows some of them as Internal links and most of them as External links. As far as I can tell, there is no real rhyme or reason to the difference between the links that are highlighted as Internal vs. External. The link structures vary greatly: Some are properly structured www10.site.com/blogs/category
Moz Bar | | Motava
And some are poor like www10.site.com/articles/show_articles.php?section=category1 So a couple questions here: Does this subdomain www10 have a detriment on the rankings of subpages?
What could possibly cause the internal links on these subpages to be highlighted as external pages with the moz toolbar?1 -
Duplicate page content
The MOZ crawler identifies pages as duplicate content which are not the same.
Moz Bar | | aignerart
The pages http://www.aignerart.com/abstracts-oil-painting/cicli-colora.html and http://www.aignerart.com/abstracts-oil-painting/murs-de-la-ville.html are marked duplicate but they are different paintings. Any ideas?0