What user agent is used by SEOMOZ crawler?
-
We have a pretty tight robots.txt file in place to only allow the major search engines. I do not want to block SEOMOZ.ORG from being able to crawl the site so I want to make sure the user agent is open.
-
Hi Eric,
The useragent of SEOMoz is: rogerbot.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Seomoz crawl: 4XX (Client Error) How to find were the error are?
I got eight 404 errors with the Seomoz crawl, but the report does not says where the 404 page is linked from (like it does for dup content), or I'm I missing something? Thanks
Moz Pro | | PaddyDisplays0 -
How to set the crawler or reports to ignore
I have a mobile version of a site with a URL string that disables the mobile view on smartphones (view full site), string is like this example.com/page-name.html?mobile=off I need the seomoz pro reports or crawler to ignore it because the crawler visits both versions of the site then reports them as duplicate content. Is there a setting page I haven't visited yet that will set this?
Moz Pro | | Str82u0 -
Seomoz keyword difficulty api
Is there a way to get this from an api or a better method than pasting 5 keywords at a time into the keyword difficulty tool to get these numbers?
Moz Pro | | insitegoogle0 -
SEOmoz campaign - keyword rankings...
Hi there, I have a quick question: Does it make a difference if I add keywords to a campaign with the '[' and ']' brackets included? I just realized that I had copy/pasted many of my keywords from the exported CSV from the Google AdWords Keyword Tool and I fear that the keyword rankings on SEOmoz might factor the brackets as part of the keywords themselves. Thanks in advance! Ben
Moz Pro | | BenHammer0 -
I have signed up for an seomoz trial .......
i have signed up for an seomoz trial but tried to access my account from a different laptop yesterday and could not a login. Is the trial version only accessible via the laptop i set it up from?!
Moz Pro | | GreatGifts4Kids0 -
Is there a beginners guide to using the tools and what do the results mean.
Great set of tools! But what would make them better is some type of guide to what the tools do (remember I am a new user) and how to maximize the results. Oh and while your at it what do the results mean.
Moz Pro | | marcreece0 -
SEOMoz Toolbar in Chrome
The SEOMoz toolbar is displayed very differently in Chrome as compared with Firefox. It 'overlaps' the page, showing on top of the content instead of offsetting the page/window. In other words, the footer or the header of the page (depending on what toolbar location is chosen in the Settings) is eclipsed by the Toolbar. This was not an issue in Firefox. Has anyone experienced the same problem with the toolbar? How can I make the toolbar integrate into the browser window itself rather that popping up on top of the rendered webpage? Thanks.
Moz Pro | | MaratM0 -
Anyone having problems with the SEOmoz KWD Tool??
Just a quicky: Tried to run keyword difficulty tool reports last couple of days but keep getting error messages regardless of how many words/phrases I request. Is this a general outage or just me? Cheers
Moz Pro | | lovealbatross
James0