Moz cannot crawl domain. Also OSE does not work properly on this specific domain?
-
Hi all,
Moz cannot crawl the domein http://www.hoesjescases.nl.
When I open the crawl report I only see one line:<colgroup><col width="229"><col width="287"><col width="420"><col width="370"><col width="141"></colgroup>
| URL | Time Crawled | Title Tag | Meta Description | HTTP Status Code |
| http://www.hoesjescases.nl | 2015-10-05T12:20:48Z | 404 : Received 404 (Not Found) error response for page. | Error attempting to request page; see title for details. | 404 |Also when running OSE on this domain, Moz only can find 4 root domains while Majestic can find 91 domains.
Google seems not to have any problems. What can be the problem for MOZ?
Greetings!
-
I have the same issue with my website: www.hoes.be
-
Thanks! I'll do that.
-
Hey There!
I'm sorry that you are having some trouble getting your site crawled. We are actually finding links in our index to unplag.com, because these links are found by crawling other sites rather than your actual site. However, we are unable to provide crawl diagnostics within your campaign because we are receiving a 400 bad request error from the site. You can also see that response using this header checker tool here: http://www.webconfs.com/http-header-check.php
In order to figure out why your site is returning this response, you would need to have your hosting provider investigate into your server.
I hope this helps! Please let me know if I can help you with anything else.
-
Hello everyone.
I have the same issue with unplag.com. Both on-page grader and website crawl are not working.
Yes, I have tried different urls.
According to Charles Mazzie - moz index changes once a month so the problem can occur because a week ago I had Rogerbot disallowed in robots.txt.
Also, moz guide says that sometimes cookie policy of my site may cause RogerBot buzzing.
Unfortunately I still haven't solved the problem. So if you can - please help.
-
Hey There,
It looks like Donna answered your question about OSE, but I wanted to follow up about the 404 you are seeing in the crawl test for http://www.hoesjescases.nl. Unfortunately, the 404 response is what is being returned from your server to our crawler: http://www.screencast.com/t/HaQJ2zd0wiG4. I did check other HTTP checkers, like hurl.it, and I'm getting a 200 for your site, so the response does seem specific to our crawler. It may be that the webmaster intended to have the server return a 403 forbidden error or something like that (which we still wouldn't be able to crawl, but would be the correct error if we are purposefully blocked), but you would need to talk to your web host to resolve the issue.
I hope this helps! Please let me know if I can help you with anything else.
Chiaryn
-
Yes, I see the same results.
If you're expecting to see more and wondering why not, that's a topic that frequently comes up in this forum. Here's one good explanation from member Charles Mazzie - https://moz.com/community/q/inbound-links-how-accurate-or-up-to-date-is-open-site-explorer. There are others you can find by searching Q&A.
-
You sure you don't just have a typo in the URL? I just tried running your domain thru open site explorer and couldn't replicate the problem.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Subdomain and nofollow backlinks are used to calculate the domain authority?
Greetings, I have a couple of questions about domain authority. 1 - The backlinks that come from different subdomains count several times or only once coming from the same domain? 2 - The nofollow backlinks are used to calculate the domain authority? Thank you.
Link Explorer | | Rosa_M0 -
Strange error in MOZ report
I get the following warning about our domain name in Link Explorer Moz tool You entered the URL debtacademy.com which redirects to www.hugedomains.com/domain_profile.cfm?d=debtacademy&e=com. Click here to analyze www.hugedomains.com/domain_profile.cfm?d=debtacademy&e=com instead. Please advice me. How I can fix it.
Link Explorer | | jeffreyjohnson0 -
Ose question
Hey why do my websites www.gardeners.scot & www.landscaping.scot not have any links showing in ose? thanks
Link Explorer | | livingphilosophy0 -
Can improving page authority on all pages help overall domain auth?
Our website is made up of approx 4000 pages - some of which are old pages with a pa of 1. I am removing these pages (ensuring they don't have links etc). Can removing so many low scoring and useless pages impact on domain authority. Our DA jumped 4 points and i wondered if this was helping Example 4000 pages in total 2500 have PA 1 - these get removed will it look better for DA that overall there are now no pages where PA =1 and the site now contains higher PA pages only?
Link Explorer | | acsilver0 -
Does Domain Authority Consider Social Signals?
I was curious if Domain Authority considers social signals. "We calculate this metric by combining all of our other link metrics—linking root domains, number of total links, MozRank,MozTrust, etc.—into a single score." Is Social included in the etc? I know you have some social data displayed in the results.
Link Explorer | | eyeflow1 -
OSE Links CSV: Download Failed - Server Problem
I'm just trying to download our Links CSV from OSE and I keep getting "Failed - Server Problem" and I got a bad gateway page when I clicked the download link in the email. Is there a problem atm?
Link Explorer | | SanjidaKazi0 -
Discrepancies between Mozbar data and OSE?
Hey everyone, I've been doing some research into keyword competition, and i've come across a few instances where the data that Mozbar provides differs pretty greatly from what open site explorer is telling me. An example: For this site: http://www.bcwsupplies.com When I have it returned in the serps, Mozbar is telling me there are 21,306 links & 218 linking root domains. But, when I check the backlink profile via OSE, it's only showing 3,020 links & 88 root domains. Can anyone shed some insight into this? Thanks!
Link Explorer | | RCDesign740