Seomoz Spider/Bot Details
-
Hi All
Our website identifies a list of search engine spiders so that it does not show them the session ID's when they come to crawl, preventing the search engines thinking there is duplicate content all over the place.
The Seomoz has bought a over 20k crawl errors on the dashboard due to session ID's. Could someone please give the details for the Seomoz bot so that we can add it to the list on the website so when it does come to crawl it won't show it session ID's and give all these crawl errors.
Thanks
-
An old answer to an old question, but one which has just helped me out tremendously. A true credit to the Q&A system!
-
Thanks Alan. much appreciated.
-
3 dots placed before last bracket, need to be removed,
-
Mozilla/5.0 (compatible; rogerBot/1.0; http://www.seomoz.org/dp/rogerbot)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEOMOZ Support: Domain Name Change in SEOMOZ
My client is changing their domain name. They are redirecting (301) all of their URLs to the new domain. Do I need to do anything in SEOMOZ to preserve the campaign?
Moz Pro | | DynoSaur0 -
SEO process suggestions / keyword analysis
hi all, we've done a bit of SEO over the years for our site, and are looking to pick things up this year and spend more time on SEO. first off, we are working on revising our keyword list & would like to view what keywords specific competitors are ranking for and try to target those keywords as well. is this possible via SEOmoz (similar to spyfu)? please let me know if you feel this is a good first step in picking up our SEO efforts for the new year. i've been looking at the research tools & is seems the Keyword Difficulty Tool hasn't been fully functional for the past week or so ("Our Keyword Difficulty Tool is having issues displaying AdWords API data. We are working with the AdWords API folks to get a fix soon!"). also, i noticed i can enter competitor sites in open site explorer & compare link metrics, but i don't see anywhere to compare keyword metrics. is there something i'm missing? thanks again everyone!
Moz Pro | | lsat0 -
SEOMOZ Crawling Our Site
Hi there, We get a report from SEOMOZ every week which shows our performance within search. I noticed for our website www.unifor.com.au that it looks through over 10,000 pages, however our website sells less than 500 products so not sure why or how so many pages are trawled? If someone could let me know that would be great. It uses up a lot of bandwidth doing each of these searches so if the amount of pages being trawled reduced it would definitely assist. Thanks, Geoff
Moz Pro | | BeerCartel750 -
Best way to improve your SEOMOZ avatar status ?
Whats the best way to improve your SEOMOZ avatar status and gain SEOMOZ brownie points? I notice some people have amazing status level such as Guru how is this possible? Surely That becomes a full time job in itself?
Moz Pro | | Bristolweb0 -
SEOmoz crawler and duplicate content
Does anybody know if the SEOmoz crawler picks up canonical tags when its looking for duplicate content? I've got a ton of errors in one of my projects even though they all have canonical tags. Thanks!
Moz Pro | | neooptic0 -
SEOmoz does not recognise < in title yet recommends it!!!!
The "<" is not recognised by SEOmoz campaign crawl bot. Bot only keeps the text before < and deletes everything else from the title! Fix needed.
Moz Pro | | petrusl0 -
SeoMoz are creawling all the time. it´s fine?
HI about 1 week, the SeoMoz told me that was crawiling all the time . i don´t know if it a problem whit the system or is new software implemented. i´ts says about 20 days crawiling thanks
Moz Pro | | monotero0 -
What's Your SEOmoz Favorite?
Obviously, SEOmoz is full of awesomeness. But I'm curious as to what sections, tools, etc. of SEOmoz are the users' favorites? For me, it's a close race between the blog, Linkscape/Open Site Explorer, and the search overlay tool on the Mozbar. What are your favorites?
Moz Pro | | Gyi0