After fixing Crawl Errors, how long does it take to for Moz or Google to re-crawl a website?
-
Last night I found out through Moz that my robots.txt file was blocking any crawling of my website. I fixed the issue. Now do I just sit and wait?
-
Moz will crawl the site every week so you'll need to wait a few days for that to happen.
In the meantime you could try using the Moz Crawl tool to do a manual crawl. Depending on the size of your site this can take a few days so you might find it's just worth waiting for the weekly crawl. You can find the crawl tool here:
https://moz.com/researchtools/crawl-test
If you site isn't included in Google's index because it was inaccessible due to the robots,txt, then you'll want to go into Google Webmaster Tools and use the Crawl -> Fetch as Googlebot to kickstart Google crawling/indexing your site.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz tried to charge our credit card
Hello, We noticed that MOZ tried to charge our credit card, while we are on Trial period until today. We decided to cancel the subscription (until our budget grows and come back). The tool is great, but it currently is too expensive for our business. We enjoyed the trial period and will surely come back when our business can afford it!! Thanks!
Getting Started | | intenseed0 -
How can I identify most relevant websites in Mexico that create content about a specific term?
Hi. I need to define the most relevant sites which are talking about a specific keyword ir order to create an PR strategy based on that term. How can I identify those sites?
Getting Started | | HarolRuiz0 -
Newbie question: 5 ways to get the most from Moz
Hi there, I'm new to Moz. I work for a furniture retailer and I'm in the process of auditing our digital presence and improving how we appear on Google and therefore to our customers. I am working on our website's content and SEO, Google Local Listing, getting our products added to Google Shopping and updating our social media accounts, removing old accounts and improving current ones. I'd like to know how to make the most of Moz. I have set our site up in Moz Pro but I'm unsure where to go next, so I was wondering if you'd be able to offer 5 tips on where to really get started. Thank you.
Getting Started | | Bee1590 -
How can I find out what is the list of keywords I currently use in my website?
How can I find out what is the list of keywords I currently use in my website? In other words I want to know my current state of keywords
Getting Started | | Rosalia.Perez0 -
Moz Analytics Shows isights, but none when i click
Hi, i have a campaign report that shows 8 Insights, however when i click on that link which says 8 Insights, the page is blank. Any info would be appreciated. Thanks
Getting Started | | andrewlos0 -
New to MOZ, can't create a campaign.
I just started the free trial today, but I can't setup a campaign. Everywhere I go (http://analytics.moz.com/pro/home, http://analytics.moz.com/manage-campaigns), all I see is: Oops! Try refreshing the page, if that doesn't work, please click here to contact our help team. Is something broken?
Getting Started | | jcsilkey0 -
Website Analysis Question
Please help with an answer, I already added a campaing for Analytics of my website and already fix the issues, how do I request a new Analysis for the same website after fixing my isuues? Thank you
Getting Started | | kattia.bolanos0 -
How do I update the crawl issues & Notifications?
I have a list of errors, most relating to missing meta descriptions. I have added a meta description to a page, visited the site and viewed the source, and the meta description is now there. When I go to analyze issues, the report it gives back for the link contains the same missing meta description as previously. How do I get it to update and realize the issue has been fixed?
Getting Started | | ETGg0