What user agent is used by SEOMOZ crawler?
-
We have a pretty tight robots.txt file in place to only allow the major search engines. I do not want to block SEOMOZ.ORG from being able to crawl the site so I want to make sure the user agent is open.
-
Hi Eric,
The useragent of SEOMoz is: rogerbot.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Seomoz crawl: 4XX (Client Error) How to find were the error are?
I got eight 404 errors with the Seomoz crawl, but the report does not says where the 404 page is linked from (like it does for dup content), or I'm I missing something? Thanks
Moz Pro | | PaddyDisplays0 -
How to download domain authority of bulk links using paid seomoz tool?
i would like to download domain authority of 50 domains at once. Is it possible with seomoz tool? If yes, can some one tell me how to do that?
Moz Pro | | Sasank0 -
SEOMoz Software
I want to start off with stating that i am truly an advocate of SEOMoz and the great stuff they have done for the inbound community that we all know and love. I've been an active member since July 2010 and a paying pro member since December 2010. The software has always been monumental in helping my clients achieve their goals. However, in the past few months i have received nothing short of buggy unreliable software. The keyword difficulty tool never returns difficulty results. The Adwords data has been gone since i can remember. The rank tracker tool is successfull close to 1 out of 5 times. OSE is updated terribly slow compared to competitors. Plus, I have had to write emails to get my campaigns to be manually refreshed to see new ranking data. I have simply missed deadlines because my data is always delayed or missing from the software. Am i an anomaly here? does anyone have these problems? I have been researching some new tools as a replacement but i have yet to find anything as robust as the old SEOMoz. I'd love some feedback. Cheers - Kyle
Moz Pro | | kchandler0 -
Using this service
Hello, I have had this service for my free month. I had over 150 errors on my website which I fixed. My problem is that in doing this my traffic is actually worse and I have now fallen completely off google. From the start of my website I would slowly creep to within t he top 3 pages of google for the search term apron and aprons, then suddenly I fall to somewhere around page 20. No one, even people I hired has been able to explain this. I hear google changes, it takes time, etc, etc... Its been 5 years and other newer companies are on the top page right in their first year.. After working with this site for a month, I have looked to page 65 for apron and aprons and still cant find me. And I know some people say Alexa is a gimmick, but now instead of rising to 10 million and falling back down to 23 million, Alexa says there is no info regarding my website whatsoever. Any advice? I was excited to have this service but I cant get my partner to agree to keep it if my month long result is worse then I ever was before. And please dont say it takes time , 5 years is more than enough. Thank you in advance!
Moz Pro | | Gardengirl0 -
Competitor using Black hat SEO
I think my competitor is using Black Hat SEO. They are a training institute but when I use the PRO tool to check their inbound links, many are links to porn sites. Is this illegal? Can i do something about it?
Moz Pro | | Jigsaw1230 -
Why would the SEOMoz Page analysis pick up exact keywords used in page title and text?
Hi, I am trying to optimise this URL : www.adaptiveconsultancy.com/ecommerce/features/advanced-ecommerce with the keyword being 'advanced ecommerce' With the 'On-Page Report Card' from SEOMoz that the exact keyword isn't featured in the page title or text, but it is in there. Why would this not be picked up? Thank you in advance,
Moz Pro | | adaptiveconsultancy
M0 -
Too many pages indexed in SEOMoz
I am running a campaign for a client that has 86 pages via Google and SEmoz is up to almost 10K pages. I am really confused. Any ideas?
Moz Pro | | LaurieK130 -
301 redirect in SEOMoz campaigns tool
I did a 301 redirect to another domain and I would like to change the domain name in SeoMoz campaigns tool to continue to track the keywords, is it possible ?
Moz Pro | | mhenriques0