How do you get Mozbot to crawl your website
-
I trying to get the mozbot to crawl my site so I can get new crawl diagnostics info. Anyone know how this can be done?
-
Bribes or maybe just dinner and a few drinks
Alas, you can't force Roger to crawl your site
"**Q. Â I just fixed a ton of issues. Can I get a new crawl?**SEOmoz crawls your site once per week. The start date is based on the date you first set up your campaign. Unfortunately, there is no way to change this date or force an earlier crawl. However, you can use the SEOmoz Custom Crawl tool to crawl up to 3000 pages of your website. Weâll email you the resulting CSV file within 24 hours."
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why did I not get on page analysis
I signed up last Friday for a 30 day trial and was hoping to get the on page analysis so I could get cracking on it. Moz said the crawl was done but I have no info for on page analysis which I find really useful when I have used this before. Any ideas and are any of the MOZ moderators able to get the system to perform one so I can make changes tonight for the MOZ crawl again tomorrow? Thanks Paul
Moz Pro | | ptrobson0 -
Can you change the websites in your PRO Dashboard?
Hello, I set a client's website in one of my 5 campaigns in my Pro Dashboard. But my client changed his domain. I don't see an option to change the domain server in the Campaign settings. Is it possible?
Moz Pro | | Eblan0 -
Why am I getting different ranking results on Google?
Because the rank checker on SEOMOZ is temporarily down for upgrade,  I followed the link over to the other suggested rank checker on seobook.com which installs a plug-in to Firefox and it seems to be working fineâŠ.BUT my question is when I check out my two highest traffic keywords which are âWhitby holiday cottagesâ and âWhitby cottagesâ against my website www.endeavourcottage.co.uk it tells me I'm ranking position 2 on both Google.com and Google.co.uk but I don't think I am. When I do the same check using a proxy server called hidemyass.com to check my rankings again on Google.co.uk and .com I appeared to be lower down the rankings like position 8. Does anyone have any idea of which is the accurate reference to my rankings? What do you do to check your rankings ? And one last quick secondary question is when I searching Google chrome using same key words again I come at the top position A on the Google maps listing but using Firefox or Internet Explorer there is no Google maps visible ways that? At the end of the day out rankings are important but where are working towards more traffic...... Cheers
Moz Pro | | whitbycottages0 -
Crawl Errors from URL Parameter
Hello, I am having this issue within SEOmoz's Crawl Diagnosis report.  There are a lot of crawl errors happening with pages associated with /login. I will see site.com/login?r=http://.... and have several duplicate content issues associated with those urls. Seeing this, I checked WMT to see if the Google crawler was showing this error as well.  It wasn't. So what I ended doing was going to the robots.txt and disallowing rogerbot. It looks like this: User-agent: rogerbot Disallow:/login However, SEOmoz has crawled again and it still picking up on those URLs.  Any ideas on how to fix? Thanks!
Moz Pro | | WrightIMC0 -
Issue in number of pages crawled
i wanted to figure out how our friend Roger Bot works. On the first crawl of one of my large sites, the number of pages crawled stopped at 10000 (due to the restriction on the pro account). However after a few weeks, the number of pages crawled went down to about 5500. This number seemed to be a more accurate count of the pages on our site. Today, it seems that Roger Bot has completed another crawl and the number is up to 10000 again. I know there has been no downtime on our site, and the items that we fixed on our site did not reduce or increase the number of pages we had. Just making sure there are no known issues with Roger Bot before I look deeper into our site to see if there is an issue. Thanks!
Moz Pro | | cchhita0 -
How often does the competitive link checker get updated?
I just found a link in the competitive link checker that links to a couple of my competitors. The checker says that i do not have a link on that page, but there is one.. i recently (last week) obtained that link. So that raises the question: how many times is the competitive link checker updated? kind regards
Moz Pro | | JarnoNijzing0 -
How long should the weekly crawl take
Mine started yesterday afternoon and it's now almost 11pm on Sunday. 30+ hours and still not finished (and no progress indicator). 438 pages quoted as being crawled. That's not normal - right? I have made a bunch of changes based on last weeks crawl so I have been eagerly waiting for this to finish But 30 hours?.... Thanks. Mark
Moz Pro | | MarkWill0 -
Can you help me get started using the crawl diagnostics report?
After getting the crawl diagnostics report for the first time my boss and I looked over it and we have tried to fix the problems but we are stumped.I have tried and watched videos , read books, etc.. but have found nothing to help. I need assistance getting started on improving my website. Can you help?
Moz Pro | | WVInjuryLawyer0