Set crawl frequency
-
Current crawl frequency is weekly, is it possible for me to set this frequency our-self?
-
This post is five years old, and I haven't worked as a Moz employee in over two years. If you email help@moz.com, they should be able to help you.
-
Can you please provide the right URL? This URL is out dated and there is no redirect... Isn't that bad SEO?
-
If you go to the URL in my first response, the instructions there will explain how it works. Have you tried visiting that URL?
-
Can you please tell me the steps for that.
Thank you.
-
You can run the crawl on demand for up to 3000 urls at a time. That should help you out between regular crawls.
-
Now i made some error correction based on the crawl report, Now i have to wait for a week for the crawl to happen to see that the errors are gone.
Is there a way for me to verify correction or regenerate the error report?
-
The crawl frequency is weekly and cannot be changed. What you can do is run a crawl test from http://pro.seomoz.org/tools/crawl-test if you need a crawl on demand.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Special Characters in URL & Google Search Engine (Index & Crawl)
G'd everyone, I need help with understanding how special characters impact SEO. Eg. é , ë ô in words Does anyone have good insights or reference material regarding the treatment of Special Characters by Google Search Engine? how Page Title / Meta Desc with Special Chars are being index & Crawl Best Practices when it comes to URLs - uses of Unicode, HTML entity references - when are where? any disadvantage using special characters Does special characters in URL have any impact on SEO performance & User search, experience. Thanks heaps, Amy
Moz Pro | | LabeliumUSA0 -
How to set up Rel=canonical in Joomla based sites
I've built a few sites using joomla (please don't tell me I should be using wordpress!!) and wondered how I can add the rel-canonical to these pages. I'm assuming it would come as a plugin or module but can't seem to find anything that works right for me. Anyone any ideas? Thanks in advance, Gordon
Moz Pro | | Gordon_Hall0 -
Do I need to set the country in Webmaster Tools even if I am set to apply the hreflang tag to our different country pages?
We are global brand that will be migrating to a new platform in the next few months. As such, this will allow us to fix our current SEO issues. We are planning on using geo-targeted subfolders instead of country code top level domains primarily because of resource limitations. My question is - do I need to set the country in Webmaster Tools even though I am already going to tell Google that certain pages are targeted towards a specific country?
Moz Pro | | marshseo0 -
Crawl Diagnostics
My site was crawled last night and found 10,000 errors due to a Robot.txt change implemented last week in between Moz crawls. This is obviously very bad so we have corrected it this morning. We do not want to wait until next Monday (6 days) to see if the fix has worked. How do we force a Moz crawl now? Thanks
Moz Pro | | Studio330 -
Is seomoz rogerbot only crawling the subdomains by links or as well by id?
I´m new at seomoz and just set up a first campaign. After the first crawling i got quite a few 404 errors due to deleted (spammy) forum threads. I was sure there are no links to these deleted threads so my question is weather the seomoz rogerbot is only crawling my subdomains by links or as well by ids (the forum thread ids are serially numbered from 1 to x). If the rogerbot crawls as well serially numbered ids do i have to be concerned by the 404 error on behalf of the googlebot as well?
Moz Pro | | sauspiel0 -
Crawl Errors Confusing Me
The SEOMoz crawl tool is telling me that I have a slew of crawl errors on the blog of one domain. All are related to the MSNbot. And related to trackbacks (which we do want to block, right?) and attachments (makes sense to block those, too) ... any idea why these are crawl issues with MSNbot and not Google? My robots.txt is here: http://www.wevegotthekeys.com/robots.txt. Thanks, MJ
Moz Pro | | mjtaylor0 -
Why won't scheduled crawl of my site begin?
I currently have a campaign running on SEOMoz for over a month. It has been showing that a crawl was scheduled to start on 12/21. Now it's 12/23 and there has not been a new crawl, and it still says scheduled for 12/21.. Anyone know why this is happening or how to fix it? Thanks
Moz Pro | | Prime850 -
Errors on my Crawl Diagnostics
I have 51 errors on my Crawl Diagnostics tool.46 are 4xx Client Error.Those 4xx errors are links to products (or categories) that we are not selling them any more so there are inactive on the website but Google still have the links. How can I tell Google not to index them?. Can those errors (and warnings) could be harming my rankings (they went down from position 1 to 4 for the most important keywords) thanks,
Moz Pro | | cardif0