Moz cannot crawl domain. Also OSE does not work properly on this specific domain?
-
Hi all,
Moz cannot crawl the domein http://www.hoesjescases.nl.
When I open the crawl report I only see one line:<colgroup><col width="229"><col width="287"><col width="420"><col width="370"><col width="141"></colgroup>
| URL | Time Crawled | Title Tag | Meta Description | HTTP Status Code |
| http://www.hoesjescases.nl | 2015-10-05T12:20:48Z | 404 : Received 404 (Not Found) error response for page. | Error attempting to request page; see title for details. | 404 |Also when running OSE on this domain, Moz only can find 4 root domains while Majestic can find 91 domains.
Google seems not to have any problems. What can be the problem for MOZ?
Greetings!
-
I have the same issue with my website: www.hoes.be
-
Thanks! I'll do that.
-
Hey There!
I'm sorry that you are having some trouble getting your site crawled. We are actually finding links in our index to unplag.com, because these links are found by crawling other sites rather than your actual site. However, we are unable to provide crawl diagnostics within your campaign because we are receiving a 400 bad request error from the site. You can also see that response using this header checker tool here: http://www.webconfs.com/http-header-check.php
In order to figure out why your site is returning this response, you would need to have your hosting provider investigate into your server.
I hope this helps! Please let me know if I can help you with anything else.
-
Hello everyone.
I have the same issue with unplag.com. Both on-page grader and website crawl are not working.
Yes, I have tried different urls.
According to Charles Mazzie - moz index changes once a month so the problem can occur because a week ago I had Rogerbot disallowed in robots.txt.
Also, moz guide says that sometimes cookie policy of my site may cause RogerBot buzzing.
Unfortunately I still haven't solved the problem. So if you can - please help.
-
Hey There,
It looks like Donna answered your question about OSE, but I wanted to follow up about the 404 you are seeing in the crawl test for http://www.hoesjescases.nl. Unfortunately, the 404 response is what is being returned from your server to our crawler: http://www.screencast.com/t/HaQJ2zd0wiG4. I did check other HTTP checkers, like hurl.it, and I'm getting a 200 for your site, so the response does seem specific to our crawler. It may be that the webmaster intended to have the server return a 403 forbidden error or something like that (which we still wouldn't be able to crawl, but would be the correct error if we are purposefully blocked), but you would need to talk to your web host to resolve the issue.
I hope this helps! Please let me know if I can help you with anything else.
Chiaryn
-
Yes, I see the same results.
If you're expecting to see more and wondering why not, that's a topic that frequently comes up in this forum. Here's one good explanation from member Charles Mazzie - https://moz.com/community/q/inbound-links-how-accurate-or-up-to-date-is-open-site-explorer. There are others you can find by searching Q&A.
-
You sure you don't just have a typo in the URL? I just tried running your domain thru open site explorer and couldn't replicate the problem.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Sudden Spike in 404 Pages Not Found in Moz Crawl But No Errors in WMT
Recently I received a spike in errors from the Moz crawler. When I looked into the matter I noticed that all the URI's looked right but then I looked a little closer and there was a /page/2 and /page/3 in front of the URI's. I'm running a WordPress website. Immediately I thought to myself this must be some kind of caching or permalinks error. So I disabled all my plugins including W3 Total Cache and ran the Integrity Link Crawler for the Mac and found that the errors were still popping up. 404-errors-ncworkercomp.png?dl=0
Link Explorer | | NCCompLawyer0 -
Is OSE having problems?
The healthpage says it is operational but I'm getting a ton of 'There was an error getting your data' messages. First I thought, it just happens to smaller pages, since testing it with moz.com worked. But even pages like nbc.com give me this error. I tried logging out an in again and even swithcing browsers - without success. Anyone else having problems like this right now? Cheers, Chris
Link Explorer | | chrwald0 -
Domain Authority and PageRank Aren't Meshing
I'm seeing a very large discrepancy between the domain authority for a site I'm tracking and the PageRank. According to PageRank Checker the PageRank is "0". According to Moz, the domain authority is 57 and page authority for the domain below is in the 32. The domain is http://bwellness.massagetherapy.com/ Open Site Explorer shows 2 linking domains -- both have D.A. scores of 13. Please explain the discrepancy. Thanks in advance.
Link Explorer | | alankoen1230 -
Are Just Discovered Links Reports Working?
I can't find my 4 month old site in Open Site Explorer. But as the site has had all of its posts tweeted I checked the Just Discovered Links reports to see if it was mentioned there. My domain is http://www.genesisclub.training but the problem is that if I target "this root domain" - I get a bunch of links that are nothing to do with my site. For example the root domain report includes sites linking to www.tinmagpie.training www.goahead.training powerquery.training http://videoproduction.training http://www.eti.training http://linkedinsales.training and more, as sites linking to my root domain. In which universe? The Just Discovered algorithm looks like it isn't coping with the .training TLD. It is treating my domain as if it were genesisclub.training.com so now anything.training is in my root domain.
Link Explorer | | diywm0 -
Moz crawler showing pages blocked by robots.txt
I've blocked a large number of pages which Moz were showing as duplicate or giving 404's in our robots.txt using /?key and /?p etc. However Moz crawler is still showing as being an issue. I assumed Roger picked up the robots.txt file, or is that not the case?
Link Explorer | | ahyde0 -
How Does Moz Assign Domain Authority?
When I use Site Explorer to test the following URL, http://jennathuening.results.net/site/index.php, it renders a domain authority of 47. (Clients site on real estate host) There are no page social metrics: no Facebook share no Facebook likes no Twitter tweets no Google+ plus 1's no "just discovered" in 60 days no one has made a post in 3 weeks much or most of the content is duplicate content across all affiliate sites inbound links - only one link - a 301 redirect http://jennathuening.results.net/ Images - 18 (Alt tags missing: 18) Created - 1998-10-15 Registered Org - REMAX RESULTS is associated with ~416 other domains Whois SEO Score 68% AND YET IT HAS A ROOT DOMAIN OF "47" and page authority of 33 More confusing, its page authority of 33 is at that top on blue background and then page 30 just listed below. When I use Site Explorer to test the following URL, http://www.homedestination.com, it renders a domain authority of 26. (Site personally owned and continually update with highly optimized fresh, relevant, quality content with grade "A" moz ranked pages and blog posts) 92 Facebook share 68 Facebook likes 13 Twitter tweets 420 Google+ plus 1's 2 "just discovered" in 60 days Images 25 (Alt tags missing: 0) inbound links - on 48 Root Domains Created - 2002-08-15 9 new indexed blog post so far in August / 19 new indexed blog post in July Whois SEO Score 100% AND YET IT HAS A ROOT DOMAIN OF "26" and page authority of 36 While I am sure there are many other factors as well; it still is hard to see where a "smaller guy" could ever be given an even opportunity to play in the same SEO arena. Could you help me understand better? I like to build a stronger marketing and optimization strategy as we are just beginning AdWord campaigns. | SEO Score | 100% |
Link Explorer | | jessential1 -
The difference between the statistics MOZ & Ahrefs
Hello dear. I have a website for a year. I made 10K links in one year(from 45 Root Domains).the Ahrefs.com has show full list of link root domains and pages. the ahrefs rank is 49. but MOZ said my Established Links are 5! So I have some questions, please help me: 1- what is difference between MOZ rank and ahrefs rank? 2-When Just-Discovered Link Calculate for my site? 3-why my moz trust is 0.00!?How to improve it? URL: https://esta-register.org
Link Explorer | | allyunit0 -
Why does Google Webmaster Tools report I have inbound links from over 120 different domains and OSE reports I have 7
My client's site is www.graysonmountainrealestate.com. Google Webmaster Tools reports I have over 120 different domains linking to the site. Why does OSE report only 7? Thanks, Ken
Link Explorer | | kdubya0