Seomoz Spider/Bot Details
-
Hi All
Our website identifies a list of search engine spiders so that it does not show them the session ID's when they come to crawl, preventing the search engines thinking there is duplicate content all over the place.
The Seomoz has bought a over 20k crawl errors on the dashboard due to session ID's. Could someone please give the details for the Seomoz bot so that we can add it to the list on the website so when it does come to crawl it won't show it session ID's and give all these crawl errors.
Thanks
-
An old answer to an old question, but one which has just helped me out tremendously. A true credit to the Q&A system!
-
Thanks Alan. much appreciated.
-
3 dots placed before last bracket, need to be removed,
-
Mozilla/5.0 (compatible; rogerBot/1.0; http://www.seomoz.org/dp/rogerbot)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does a subdomain hurt/help a domain?
My organization's website currently hosts research databases on a subdomain. We're relatively new to MOZ and when I ran a crawl of my site, it came back with 30K issues.... 98% of which are on this subdomain. I wish I could just remove it and call it a day, however, real and active researchers use it regularly. My question is: Does a subdomain hurt/help a domain? I'm seeing mixed results via Google search and browsing this forum. I'm concerned that I will not be able to fix these 30K issues as I do have access to maintain this database... and just by looking at it you can tell it was built in 2005 and hasn't been updated from an SEO perspective since. Any suggestions?
Moz Pro | | mlothamer0 -
Confused - SEOMoz Reporting On Different Domains?
I wasn't sure which report to set up on my domain, so I set up 2 different ones which now appear like this in the Dashboard under the Campaigns section: *mysite.com www.mysite.com I want to delete the wrong report, but I noticed that they produce two slightly different report results which is interesting. My domain does not have any subdomains - which report should I delete?
Moz Pro | | Ubique0 -
Is there a way to export keywords from SEOMOZ?
Hi, is there a way to export keywords of a campaign in SEOMOZ? The other way around to import including labels? Best
Moz Pro | | ValerieSchmidt0 -
Are seomoz ranking in jeopardy?
A few weeks ago Raventools announced that they would no longer be able to provide tools based on the adwords API, then withdrew that. Rand commented on a thread here discussing that and made similar noises. Today Raventools made an announcement as SERP tracking with wording that sounded a lot like it had more than a little influence from Google. Would I be really paranoid to be wondering whether the Rankings tools in seomoz could be at risk?
Moz Pro | | matbennett1 -
About Duplicate Content found by SEOMOZ... that is not duplicate
Hi folks, I am hunting for duplicate content based on SEOMOZ great tool for that 🙂 I have some pages that are mentioned as duplicate but I cant say why. They are video page. The content is minimalistic so I guess it might be because all the navigation is the same but for instance http://www.nuxeo.com/en/resource-center/Videos/Nuxeo-World-2010/Nuxeo-World-2010-Presentation-Thierry-Delprat-CTO and http://www.nuxeo.com/en/resource-center/Videos/Nuxeo-World-2010/Nuxeo-World-2010-Presentation-Cheryl-McKinnon-CMO are mentioned as duplicate. Any idea? Is it hurting? Cheers,
Moz Pro | | nuxeo0 -
Where is the labs LDA topics tool? The articles mentioning it point to http://www.seomoz.org/labs/lda but that forwards me to the tools landing page.
I searched SEOMOZ for this but haven't yet found the answer. It seems that it's been removed. I'm sure it was announced somewhere that I missed
Moz Pro | | bluenote0 -
Hay en SEOMoz una comunidad de habla hispaña?
Hola a todos, me interesa intercambiar informacion sobre SEO con personas de habla hispaña. Existe en SEOMoz una grupo que nos junte a tosdos? Un Saludo a los que comprenden este texto sin la necesidad de utilizar google traslator. Cesar A Amico.
Moz Pro | | abbath2