Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
0 status codes
-
Hi,
I am hoping someone could help explain - I have a screaming frog account and ran a crawl using it, it returned a lot of 0 status codes 'connection timeout', 'DNS lookup failed' and 'Connection Refused'. However, the SEO MOZ Crawl doesn't detect any of this.
I am fairly new to these tools, do you know why this is?
Thanks a lot!
-
Hi Kayleigh,
Like Patrick said, just try to recrawl these pages. I assume that will fix the problem.
If that still gives the errors I would make sure to try it again with adjusted speed. Some servers automatically block crawlers (IP’s) that give a spike in there server requests. Screaming Frog can easily trigger this (happened to me aswell). You can set the speed under configuration.
If you give this a try I would go with one thread at a time and 0,5 URL’s a second. That worked for me. When it was a block it could be needed to get your IP address unblocked before you try it again. Good luck!
-
Hi Kayleigh
This happens from time to time. Sometimes I will pull the URLs I get those 0 status errors for and recrawl them. It's no big deal, sometimes you just have to mess with the configuration of your crawls.
ScreamingFrog offers some tips in their FAQ section, you can read those here.
Hope this helps! Let me know if you have any more questions or comments.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved How can I improve SEO for my auditing firm’s website?
Hi Moz community! I run aauditing.com, offering audit, tax consulting, and accounting services in the UAE. I’m looking for effective SEO strategies to boost visibility and attract clients. Any tips on content optimization, backlinks, or local SEO would be appreciated!
Getting Started | Nov 11, 2024, 10:53 AM | HFM972 -
Unsolved How can I shorten a url?
I've got way too many long url's but I have no idea how to shorten them?
Getting Started | Oct 25, 2024, 8:02 AM | laurentjb0 -
Unsolved Crawler was not able to access the robots.txt
I'm trying to setup a campaign for jessicamoraninteriors.com and I keep getting messages that Moz can't crawl the site because it can't access the robots.txt. Not sure why, other crawlers don't seem to have a problem and I can access the robots.txt file from my browser. For some additional info, it's a SquareSpace site and my DNS is handled through Cloudflare. Here's the contents of my robots.txt file: # Squarespace Robots Txt User-agent: GPTBot User-agent: ChatGPT-User User-agent: CCBot User-agent: anthropic-ai User-agent: Google-Extended User-agent: FacebookBot User-agent: Claude-Web User-agent: cohere-ai User-agent: PerplexityBot User-agent: Applebot-Extended User-agent: AdsBot-Google User-agent: AdsBot-Google-Mobile User-agent: AdsBot-Google-Mobile-Apps User-agent: * Disallow: /config Disallow: /search Disallow: /account$ Disallow: /account/ Disallow: /commerce/digital-download/ Disallow: /api/ Allow: /api/ui-extensions/ Disallow: /static/ Disallow:/*?author=* Disallow:/*&author=* Disallow:/*?tag=* Disallow:/*&tag=* Disallow:/*?month=* Disallow:/*&month=* Disallow:/*?view=* Disallow:/*&view=* Disallow:/*?format=json Disallow:/*&format=json Disallow:/*?format=page-context Disallow:/*&format=page-context Disallow:/*?format=main-content Disallow:/*&format=main-content Disallow:/*?format=json-pretty Disallow:/*&format=json-pretty Disallow:/*?format=ical Disallow:/*&format=ical Disallow:/*?reversePaginate=* Disallow:/*&reversePaginate=* Any ideas?
Getting Started | Sep 2, 2024, 4:25 PM | andrewrench0 -
Unsolved Website Traffic
Greetings All. I'm working on a new business website for a client, and I've been accessing the site numerous times daily (troubleshooting, confirming changes, etc.). I've been using Google search to access the site, and I use a VPN so that my IP would be random. So I would presume that the site traffic should be increasing. But on the last Moz Pro crawl, the site traffic was still listed as 0.
Getting Started | May 30, 2024, 10:49 AM | depawl52
Is there a minimum amount of traffic required before Moz recognizes it or is something else going on?
Thank you.0 -
Unsolved Domain Overview - no NZ?
Why on Domain Overview are there only 4 countries to choose from? I am in NZ and need to check websites that operate businesses in NZ not Canada, US or Australia?
Getting Started | Apr 5, 2024, 8:06 PM | KapitiGirl0 -
Moz not able to crawl our site - any advice?
When I try and crawl our site through Moz it gives this message: Moz was unable to crawl your site on Aug 7, 2019. Our crawler was banned by a page on your site, either through your robots.txt, the X-Robots-Tag HTTP header, or the meta robots tag. Update these tags to allow your page and the rest of your site to be crawled. If this error is found on any page on your site, it prevents our crawler (and some search engines) from crawling the rest of your site. Typically errors like this should be investigated and fixed by the site webmaster. I have been through all the help and doesn't seem to be any issues. You can check the site and robots.txt here: https://myfamilyclub.co.uk/robots.txt. Anyone got any advice on where I could go to get this sorted?
Getting Started | Jun 27, 2024, 8:47 PM | MyFamilClubLtd1 -
Has anyone purchased the MOZ SEO courses? Are they good?
I'm looking to learn more about SEO. Has anyone purchased the courses available through MOZ? If so, are they useful?
Getting Started | Apr 8, 2024, 4:41 PM | Stevepair0 -
Error Code 804: HTTPS (SSL) Error Encountered
Recently we bought SSL and moved our site to https. (https://www.kitchenstuff.com) where all link are https even after I see an error "Error Code 804: HTTPS (SSL) Error Encountered". Can anyone help me out? What steps can I take to troubleshoot this error?
Getting Started | Jul 21, 2016, 7:06 PM | torbett0