'Domain Does Not Respond To Web Requests'
-
Hi everyone,
This seems to be a fairly common query on the Q&A section, but I haven't been able to find a solution by reading through previous threads.
When I try to set up an SEOmoz campaign for spryz.co.nz, I get that ol' favourite error message:
'We have detected that the domain spryz.co.nz does not respond to web requests. Using this domain, we will be unable to crawl your site or present accurate SERP information.'
The problem isn't being caused by a Robots.txt file, and the site has experienced 99% uptime since it was launched.Traffic stats show that visits are coming through to the site via the search engines, suggesting that it may not be all crawlers that fail to access the site.
I've tried to set up this campaign several times throughout the day, since I've read that sometimes Roger goes on the blink, but I've still not been successful.
Any suggestions as to why Roger might be unable to crawl my website would be great.
-
Having the same issue - would prefer not to post the domain name though. It's my first time using SEOMoz, new PRO user, and I'm literally blocked from my first campaign. The site is responsive, hosted on a great server, there's a robots.txt that's intact and is only disallowing access to one particular directory, and the site is currently indexed in Google because I can see the pages.
Methinks there's something wrong on your end - this question has 120 views which means it's more than a few isolated cases. Should I just go ahead and set up the campaign anyway, ignoring the error?
-
Hi there,
Thanks for reaching out! That is interesting indeed that you aren't able to create a campaign for that particular domain. I do notice that I had trouble at first, but I tried again immediately and was able to go past the no response screen and create a campaign. http://screencast.com/t/H2apiZb0tvB. I have checked with our team and we are not seeing an issue with the crawler so far, however in the past our crawler have had trouble with pages that is missing a Robots.txt (404 when I checked it last) http://screencast.com/t/oacVSiHM3Nyf. However as I have shown, our crawler will now crawl sites in the absence of a robot.txt.
There's a few reason why it could be not responding to our web request:
1. The uptime was sporadic when we made the attempt.
2. Something on the server level is blocking our web service, which is provided by Amazon.Unfortunately the problem is too sporadic, I will start a ticket for you on my end and let's see how my campaign comes back before we decide anything. Hope that helps!
Best,
Peter SEOmoz Help Team.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can I view Domain Authority stats for longer than the previous 12 months?
When you view the DA chart, it goes back 12 months. There is no apparent way to see any data before that. I searched the Q&A but see no other similar questions. Any insight?
Getting Started | | cptutty0 -
Standard Syntax in robots.txt doesn't prevent Moz bot from crawling
A client is getting many false positive site crawl errors for things like duplicate titles and duplicate content on pages that include /tag/ in the URL. An example is https://needquest.com/place_tag/autism-spectrum-disorder/page/4/ To resolve this we have set up a disallow statement in the robots.txt file that says
Getting Started | | btreloar
Disallow: /page/ For some reason this appears not to work, as the site crawl errors continue to list pages like this. Does anyone understand why that would be and what we need to do to properly disallow crawling these pages?0 -
I haven't used Moz and you've been billing me. Please refund thanks
I signed on for a free trial and found out today that you've billed me in June and July. Check my history as this is only the second time i've logged in and it's just to request you refund.
Getting Started | | Completebanker0 -
Custom report doesn't list keywords.
I'd like a report which shows a list of all the keywords and their ranks - s it possible to get a complete list in the report rather than just summary of rankings?
Getting Started | | ukandyh0 -
Pro just NOTworking, won't add campaigns...help!
I have been a member before, but cancelled due to Moz not doing daily ranking. Signed up again, as i like the reporting facility, and now have planned to use this along with Rankinity. I got the free trial, added in two new campaigns, which is not a quick process if you do it correctly, and neither are showing up in my campaigns tab. So I thought, maybe its because it's a free trial...so I upgraded to the 149/month, and got billed. Tried adding a campaign again, and nada. Also tried activating archived campaigns...again, nothing. Nothing is working, talking directly to Moz is pretty much impossible (no phone number, the 'talk to us' button never gets a response - tried that on Friday), so I am trying to get some kind of answers here. What I would like from Moz is: 1. Make the adding campaigns thing work asap (I need to make the client reports soon). 2. Make it so my old archived ones, when I click the activate button work. 3. If they are feeling nice for wasting hours of my time, maybe refunding my sub for the month and putting me back on the free trial or something. My head is about to explode....HELPPPPP! Love, Jeannie xo
Getting Started | | Jeannie.0 -
Moz Analytics - How can I turn a whole report to 'Monthly'?
Hello, After spending 3 days setting up 14 clients on this system, by this, I mean I went through each client and re-made the same report 14 times as there is no alternative..I have noticed on my reports that: 'Dashboard' is set to 'Weekly' Social is set to 'Daily' Branding is set to 'Monthly' First questions, when I try to run a report, I go to Add Module and change 'Weekly' to 'Monthly', but when I press next, it changes itself back again, am I doing something wrong? UPDATE: I have found that I have go back in the reports, change the heading to 'Monthly' and then re-add this section again. How can I just run a whole report with monthly values? Surely, I do not have to re-do the entire report AGAIN, just to get a different value? I am mortified at how unfinished this product is, if this is the case.
Getting Started | | Paul_Tovey0 -
New to MOZ and working with Web Mentions. Can I use operators?
Our name is HostDime but often put as Host Dime (2 words) by news sources and other sites. How do I set up my brand mention so I only get a notice when both words appear, in order, together. I don't want "That host is a dime" and such. Can I use a +Host +Dime?"Host Dime"? Do these operators work in MOZ?
Getting Started | | hostdime0 -
Oops! This doesn't appear to be a valid URL. Please try again.
Hi, I just started with using MOZ and at my first attemp I can not start a new campaign because my url doesn't appear to be valid.. I tried http://www.mydomain.nl , www.mydomain.nl and mydomain.nl.. It's a Dutch extension (.nl). Can this be the problem? Excuse me my spelling and typo's. I'm Dutch 🙂
Getting Started | | SWP0