Moz cannot crawl domain. Also OSE does not work properly on this specific domain?
-
Hi all,
Moz cannot crawl the domein http://www.hoesjescases.nl.
When I open the crawl report I only see one line:<colgroup><col width="229"><col width="287"><col width="420"><col width="370"><col width="141"></colgroup>
| URL | Time Crawled | Title Tag | Meta Description | HTTP Status Code |
| http://www.hoesjescases.nl | 2015-10-05T12:20:48Z | 404 : Received 404 (Not Found) error response for page. | Error attempting to request page; see title for details. | 404 |Also when running OSE on this domain, Moz only can find 4 root domains while Majestic can find 91 domains.
Google seems not to have any problems. What can be the problem for MOZ?
Greetings!
-
I have the same issue with my website: www.hoes.be
-
Thanks! I'll do that.
-
Hey There!
I'm sorry that you are having some trouble getting your site crawled. We are actually finding links in our index to unplag.com, because these links are found by crawling other sites rather than your actual site. However, we are unable to provide crawl diagnostics within your campaign because we are receiving a 400 bad request error from the site. You can also see that response using this header checker tool here: http://www.webconfs.com/http-header-check.php
In order to figure out why your site is returning this response, you would need to have your hosting provider investigate into your server.
I hope this helps! Please let me know if I can help you with anything else.
-
Hello everyone.
I have the same issue with unplag.com. Both on-page grader and website crawl are not working.
Yes, I have tried different urls.
According to Charles Mazzie - moz index changes once a month so the problem can occur because a week ago I had Rogerbot disallowed in robots.txt.
Also, moz guide says that sometimes cookie policy of my site may cause RogerBot buzzing.
Unfortunately I still haven't solved the problem. So if you can - please help.
-
Hey There,
It looks like Donna answered your question about OSE, but I wanted to follow up about the 404 you are seeing in the crawl test for http://www.hoesjescases.nl. Unfortunately, the 404 response is what is being returned from your server to our crawler: http://www.screencast.com/t/HaQJ2zd0wiG4. I did check other HTTP checkers, like hurl.it, and I'm getting a 200 for your site, so the response does seem specific to our crawler. It may be that the webmaster intended to have the server return a 403 forbidden error or something like that (which we still wouldn't be able to crawl, but would be the correct error if we are purposefully blocked), but you would need to talk to your web host to resolve the issue.
I hope this helps! Please let me know if I can help you with anything else.
Chiaryn
-
Yes, I see the same results.
If you're expecting to see more and wondering why not, that's a topic that frequently comes up in this forum. Here's one good explanation from member Charles Mazzie - https://moz.com/community/q/inbound-links-how-accurate-or-up-to-date-is-open-site-explorer. There are others you can find by searching Q&A.
-
You sure you don't just have a typo in the URL? I just tried running your domain thru open site explorer and couldn't replicate the problem.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz tool to estimate a website's organic traffic?
Moz has tons of great tools, so I was quite suprised there is nothing similar to Alexa's siteinfo tool, or SimilarWeb's site comparison tool. Am I missing something? Or does such a tool exists at Moz? Or is there a different way of estimating my competitor's traffic? It would be great if Moz would have something like that.
Link Explorer | | GrandRapids0 -
Moz's new Link Explorer displaying the DA marginally less than Site Explorer
Moz's new Link Explorer displaying the DA marginally less than Site Explorer. Old one is showing it 46 while new link explorer is showing the DA as 40.
Link Explorer | | dhananjay.kumar11 -
Internal Pages marked as Spam by Moz
Hello,
Link Explorer | | Umesh-Chandra
We use Moz for our website,Open site explorer marks many of the internal pages of the website as spam. Even pages such as careers, privacy policy etc. Please let us know why is this the case ? Also does these pages have impact on overall rankings of the website ?, If yes, What should we do about it ? Please clarify. Thanks.0 -
MOZ competitor analysis tool
Hi Guys Has anyone also noticed that the MOZ competitor analysis tool does not always pick up on all back-links? If I put two competitors into MOZ and Ahrefs I get so many more back-link info from Ahrefs. Has anyone else experienced the same issue? Thanks Jon
Link Explorer | | NaughtyChilli0 -
Why is moz telling me I have duplicate content, but neither the content nor the urls are duplicates?
I just upgraded our website to a new one. This is the first crawl of the new website. It is telling me I have 24 Critical issues, all of which are duplicate content errors. Thing is, the urls are not duplicates and the content on the page is not duplicated either. Example, here is one error where it says there are two duplicates: <colgroup><col width="595"></colgroup>
Link Explorer | | damon1212
| http://winterguardtarps.com/portfolio-item/props-10 |
| http://winterguardtarps.com/portfolio-item/props-2 |
| http://winterguardtarps.com/portfolio-item/props-7 | There are photos in our portfolio, and none of them are the same. I'm a bit of a noob, but what am I missing here?0 -
How long will it take for the changes we've made to reflect in Moz OSE spam score data?
I signed up for Moz to see the spam flags our site had triggered. As soon as I found out, we worked on it and have been trying to correct our mistakes but it's been more than a month and we've managed to neutralise zero flags. I would appreciate if someone can clarify how long the OSE data takes to refresh. Also, how do you combat the following three specific flags: Ratio of Followed to Nofollowed Subdomains Ratio of Followed to Nofollowed Domains Low Number of Pages Found Crawl only gets a valid response to a small number of pages. Thanks.
Link Explorer | | Oziti0 -
Domain Authority dropped by 9!
Hello Mozzers, I have logged onto MOZ this morning to see that my domain authority has slipped (seemingly overnight) from 61 to 52! The competitors i track have also slipped but not as dramatically as me and my domain. Is this an expected change in the algorithm? Have all industries been affected? Any help / explanation would be very much appreciated. Ben
Link Explorer | | Bendall0 -
Any idea why ose is so slow in generating reports?
Hi Everyone, Having some real issues when I generate a report from OSE. It's external only links csv and they seem to take forever before I can download them. Is it an OSE issue or something my end? Thanks In advance Kevin
Link Explorer | | itineris_ltd0