Moz cannot crawl domain. Also OSE does not work properly on this specific domain?
-
Hi all,
Moz cannot crawl the domein http://www.hoesjescases.nl.
When I open the crawl report I only see one line:<colgroup><col width="229"><col width="287"><col width="420"><col width="370"><col width="141"></colgroup>
| URL | Time Crawled | Title Tag | Meta Description | HTTP Status Code |
| http://www.hoesjescases.nl | 2015-10-05T12:20:48Z | 404 : Received 404 (Not Found) error response for page. | Error attempting to request page; see title for details. | 404 |Also when running OSE on this domain, Moz only can find 4 root domains while Majestic can find 91 domains.
Google seems not to have any problems. What can be the problem for MOZ?
Greetings!
-
I have the same issue with my website: www.hoes.be
-
Thanks! I'll do that.
-
Hey There!
I'm sorry that you are having some trouble getting your site crawled. We are actually finding links in our index to unplag.com, because these links are found by crawling other sites rather than your actual site. However, we are unable to provide crawl diagnostics within your campaign because we are receiving a 400 bad request error from the site. You can also see that response using this header checker tool here: http://www.webconfs.com/http-header-check.php
In order to figure out why your site is returning this response, you would need to have your hosting provider investigate into your server.
I hope this helps! Please let me know if I can help you with anything else.
-
Hello everyone.
I have the same issue with unplag.com. Both on-page grader and website crawl are not working.
Yes, I have tried different urls.
According to Charles Mazzie - moz index changes once a month so the problem can occur because a week ago I had Rogerbot disallowed in robots.txt.
Also, moz guide says that sometimes cookie policy of my site may cause RogerBot buzzing.
Unfortunately I still haven't solved the problem. So if you can - please help.
-
Hey There,
It looks like Donna answered your question about OSE, but I wanted to follow up about the 404 you are seeing in the crawl test for http://www.hoesjescases.nl. Unfortunately, the 404 response is what is being returned from your server to our crawler: http://www.screencast.com/t/HaQJ2zd0wiG4. I did check other HTTP checkers, like hurl.it, and I'm getting a 200 for your site, so the response does seem specific to our crawler. It may be that the webmaster intended to have the server return a 403 forbidden error or something like that (which we still wouldn't be able to crawl, but would be the correct error if we are purposefully blocked), but you would need to talk to your web host to resolve the issue.
I hope this helps! Please let me know if I can help you with anything else.
Chiaryn
-
Yes, I see the same results.
If you're expecting to see more and wondering why not, that's a topic that frequently comes up in this forum. Here's one good explanation from member Charles Mazzie - https://moz.com/community/q/inbound-links-how-accurate-or-up-to-date-is-open-site-explorer. There are others you can find by searching Q&A.
-
You sure you don't just have a typo in the URL? I just tried running your domain thru open site explorer and couldn't replicate the problem.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why are my trackable links appearing in my site crawls?
Our Google-created trackable campaign URLs are appearing in site crawls and often triggering error warnings.
Link Explorer | | K.Reeves0 -
Moz crawling doesn't show all of my pages
Hello, I'm trying to make an SEO on-pages audit of my website. When using the SEO crawl, i see only one page while i have much more pages in this website (200+). Is it an issue with the sitemap ? The robot.txt ? How can i check and correct this. My website is discoolver.com
Link Explorer | | MK-Discoolver1 -
[URGENT] Domain Authority drops from 25 to 1
Hello, We have about 9 websites connected to moz. We frequently are checking reports and crawls. From November 24 to December 18th there was a dramatic drop from 25 to 1 one only one of our sites. Our Linking C-Blocks went from 2 to 0, Domain MozRank went from 3.75 to zero. Essentially everything that we have worked for and ranked in for the past 5 years of the website being live dropped to zero. We are extremely frustrated and we are doing everything out of our power to figure out what may have happened. Here are a few things that we have done in that time and we are hoping someone might be able to direct us in the right direction on what may be the issue. We are in the process of pushing our new website. We have added our new website to a site_root_2 directory. In this directory we have robots no follow metas and a robots.txt. We do this prior to pushing our new websites. We move our website to the root when it is done. We have also forced all our urls to https. If anyone could help us get to the bottom of this issue we would greatly appreciate it. Thanks
Link Explorer | | jkloosterman0 -
My title has a TM symbol and Moz says I don't have the keyword in my title
Moz gave me a poor rating because I don't have the keyword in my title but I do, it just has a trademark symbol. Pelican 1500 Case is the keyword I'd like to rank for on this page: http://www.thepelicanstore.com/pelican-1500-case-1014.aspx Moz says the keyword doesn't exist on the page. Should I ignore it, remove it or otherwise change it? I feel the trademark symbol would help with CTR in the title.
Link Explorer | | bREALmarketing0 -
Learn how to use Moz's Link Intersect tool to build your link profile. Get your Daily SEO Fix!
The quantity and (more importantly) quality of backlinks to your website make up your link profile; one of the most important elements in SEO and an incredibly important factor in search engine rankings. In today's Daily SEO Fix, How to Use Link Intersect to Build Your Link Profile, Tori shows you how to use Moz's Link Intersect tool to analyze the competitions' backlinks plus, find opportunities to build links and strengthen your own link profile. This video is one of our last videos in The Moz Daily SEO Fix tutorial series--Moz tool tips and tricks in under 2 minutes. To watch all of our videos so far, make sure to visit the Daily SEO Fix channel on YouTube. And, if you have suggestions for future tutorials, please let us know via the comments below. Thanks!
Link Explorer | | kellyjcoop2 -
Big drop in Domain Authority
Hello there, Our domain authority dropped yesterday from 37 to 33 yesterday Our domain name is: http://www.wallpapered.com We have been building a few quality/relevant links in the last month so am very surprised by this big drop? Would appreciate everyone's feedback? Thanks
Link Explorer | | roberthseo5 -
How quickly does Domain Authority and Page Authority update
Hi, I think I read somewhere that domain authority and page authority are updated twice a month - is this true? The reason I ask is because I had a very successful content piece released last month (around 20th May) that received some great links (mainly to a landing page, but also many links to my home page) from highly respected sources such as Time.com, Spin.com, RollingStone.com, DailyMail.co.uk... However, my domain authority hasn't changed at all, and the page authority for the page is only 47, which I was hoping would be higher for a page that received millions of visitors, 100k+ Facebook likes, and a wealth of sites linking in. Also, in OpenSiteExplorer, when checking against my home page, it says there are no Just-Discovered links for the last 60 days - again, I'm puzzled, as my home page has been referenced by many leading news sites. Many thanks
Link Explorer | | mjk260 -
OSE Export very slow
Anyone else having issues with Open Site Explorer? Been trying to export a backlink report for a website for the past 2 hours (the grey bar has been going that long). The site only has 1937 backlinks!!
Link Explorer | | Grumpy_Carl0