How often does seomoz crawl the site? Can you force a crawl at a specific time ?
-
How often does seomoz crawl the site? Can you force a crawl at a specific time ?
-
Thanks, sussed now
-
Yep. Depends on exactly when you set up your campaigns. You will get an email when your site has been crawled by the seomoz bot. Then shortly after that you will get a ranking update email.
You cant control the crawl rate.
-
Thanks guys, as I suspected, worth a look at this by moz dev team
-
Yeah, same here. It is done on a recurring weekly basis on the same day of the week you had initially setup the campaign.
-
All my campaigns (different sites) are crawled weekly. As far as I understand you can;t control this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Crawl Diagnostics saids a page is linking but I can't find the link on the page.
Hi I have just got my first Crawl Diagnostics report and I have a questions. It saids that this page: http://goo.gl/8py9wj links to http://goo.gl/Uc7qKq which is a 404. I can't recognize the URL on the page which is a 404 and when searching in the code I can't find the %7Blink%7D in the URL which gives the problems. I hope you can help me to understand what triggers it 🙂
Moz Pro | | SebastianThode0 -
What to do with a site of >50,000 pages vs. crawl limit?
What happens if you have a site in your Moz Pro campaign that has more than 50,000 pages? Would it be better to choose a sub-folder of the site to get a thorough look at that sub-folder? I have a few different large government websites that I'm tracking to see how they are fairing in rankings and SEO. They are not my own websites. I want to see how these agencies are doing compared to what the public searches for on technical topics and social issues that the agencies manage. I'm an academic looking at science communication. I am in the process of re-setting up my campaigns to get better data than I have been getting -- I am a newbie to SEO and the campaigns I slapped together a few months ago need to be set up better, such as all on the same day, making sure I've set it to include www or not for what ranks, refining my keywords, etc. I am stumped on what to do about the agency websites being really huge, and what all the options are to get good data in light of the 50,000 page crawl limit. Here is an example of what I mean: To see how EPA is doing in searches related to air quality, ideally I'd track all of EPA's web presence. www.epa.gov has 560,000 pages -- if I put in www.epa.gov for a campaign, what happens with the site having so many more pages than the 50,000 crawl limit? What do I miss out on? Can I "trust" what I get? www.epa.gov/air has only 1450 pages, so if I choose this for what I track in a campaign, the crawl will cover that subfolder completely, and I am getting a complete picture of this air-focused sub-folder ... but (1) I'll miss out on air-related pages in other sub-folders of www.epa.gov, and (2) it seems like I have so much of the 50,000-page crawl limit that I'm not using and could be using. (However, maybe that's not quite true - I'd also be tracking other sites as competitors - e.g. non-profits that advocate in air quality, industry air quality sites - and maybe those competitors count towards the 50,000-page crawl limit and would get me up to the limit? How do the competitors you choose figure into the crawl limit?) Any opinions on which I should do in general on this kind of situation? The small sub-folder vs. the full humongous site vs. is there some other way to go here that I'm not thinking of?
Moz Pro | | scienceisrad0 -
In the hierarquical structure of the site I would like to define a campaign in a given level of that structure down to leafs. How can I define it?
I have many categories in my site and each one has others sub categorias and so on until the last categories points to products pages. I want a campaign that crawls just from a given category (or sub category) down to all produtcs pages. How can I do that? I am not sure if defining a folder would accomplish taht? Lets say I have category C, D and E. Sub categories on D are D1, D2, D3 and producs on D3 are D3P1, D3P2 and so on... How can I define a campaig on category D3 and get D3, D3P1, D3P2 crawled?
Moz Pro | | bistro0 -
What is the correlation between the SEOMOZ PR number and where my site is showing up in an organic search?
For years, our company placed 3 or 4 in an organic search on Google for the keyword I am inquiring about. A couple of months ago, we went down to number 15. I then subscribed to SEOMOZ and began a concerted effort to improve our ranking for this keyword. Slowly, our listing came up higher in searches and on our reports- back onto the first page #8. Our weekly SEOMOZ reports reflected this improvement, but then it dropped down again to page 2, #11. My most recent report, this week, gave us a PR 8 for this keyword, but our listing is showing upon page 2, #11. I do have my personal search and browser history disabled. I am unclear as to why there is this discrepancy.
Moz Pro | | gfiedel0 -
SEOMoz Campaign
Just how lagged are the rankings on SEOMoz Campaigns? They seems to be weeks behind what I actaully see.
Moz Pro | | freestone0 -
How long does it typically take MOZBOT to crawl a site?
Our site has had "crawl in progress" for over 24 hours now without an update, we're dying for the results since our last changes :).
Moz Pro | | absoauto0 -
Lots of site errors after last crawl....
Something interesting happened on the last update for my site on SEOmoz pro tools. For the last month or so the errors on my site were very low, then on the last update I had a huge spike in errors, warnings, and notices. I'm not sure if somehow I made a change to my site (without knowing it) and I caused all of these errors, or if it just took a few months to find all the errors on my site? My duplicate page content went from 0 to 45, my duplicate page titles went from 0 to 105, my 4xx (client error) went from 0 to 4, and my title missing or empty went from 0 to 3. On the warnings sections my missing meta description tag went form a hand full to 444. (most of these looking to be archive pages.) Down in the notices I have over 2000 that are blocked by meta robots, meta-robots nofollow, and Rel canonical. I didn't have any where near this many prior to the last update of my site. I just wanted to see what I need to do to clean this up, and figure out if I did something to cause all the errors. I'm assuming the red errors are the first things I need to clean up. Any help you guys can provide would be greatly appreciated. Also if you'd like me to post any additional information, please let me know and I'd be glad to.
Moz Pro | | NoahsDad0 -
Crawl Errors Confusing Me
The SEOMoz crawl tool is telling me that I have a slew of crawl errors on the blog of one domain. All are related to the MSNbot. And related to trackbacks (which we do want to block, right?) and attachments (makes sense to block those, too) ... any idea why these are crawl issues with MSNbot and not Google? My robots.txt is here: http://www.wevegotthekeys.com/robots.txt. Thanks, MJ
Moz Pro | | mjtaylor0