Unsolved Replicate rogerbot error for server/hosting provider
-
Anyone got any ideas how to get a server/hosting provider who is preventing rogerbot from crawling and me not been able to set up a campaign to duplicate the error on there end?
The server/hosting provider is crazydomains dot com
My clients robots.txt
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
User-agent: rogerbotDisallow:
Sitemap: https://www. something
-
Hi guys. I decided to try this site https://nocramming.com/testingmom-review to prepare my child for testing before entering a new school, and the results have exceeded my expectations. TestingMom provides an extensive selection of materials and exercises to help children improve their academic skills and develop problem-solving strategies. My child has improved quickly with this resource and I am very grateful to the TestingMom team for their work
-
Moving-Web-SEO-AucklandMoving-Web-SEO-Auckland
if you facing any error in your hosting kindly contact the https://www.leasedlayer.com/ I would like to recommend this company because I have hosted my company site with this service provider I am running my site in a smooth way and their customer support is marvelous
-
@tom-capper
Thanks Tom was more about server settings outside of robots.txt for hosting providers.
Managed to get them to remove rogerbot blocking on ALL there servers as they first stated that it was well known as a malicious robot hence the block???
Until I made them aware.... cough cough -
There are a bunch of third party tools that would allow you to validate robots.txt against a given user agent.
For example:
- https://technicalseo.com/tools/robots-txt/ (includes Moz user agents in dropdown)
- https://www.realrobotstxt.com/ (allows you to copy/paste a test robots file)
Without the hosting provider having a Moz account & campaign of their own, this is probably the easiest way to get them to replicate the error.
Tom
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved How to check the Domain Age?
Check the Domain Age on THE SEO TOOLS KING
Moz Tools | | seotoolsking
Get Free seo tools only on THE SEO TOOLS KING4 -
Unsolved Search volume as a factor in search visibility
Is search volume a factor in calculating visibility in Moz? Is search volume a factor is or it just keyword rankings?
Moz Tools | | davidevans_seo0 -
Unsolved New Clients with Horrible Rankings
Bringing on a handful of established clients that have never focused on SEO. Needless to say, they will be starting past page 5 on many items. What is the best tactic to figure out their ranking, determine progress internally and also provide movement reports when they are past the five page limit?
Moz Tools | | StartupStreet0 -
Unsolved Is Performance Metrics only available in a Campaign?
I'm looking to do a 1-off Performance Metrics analysis across dozens of pages on a single website - a prospective client. I thought it would be part of the On-Demand Crawl.
Moz Tools | | amandacash858960 -
Unsolved reduce spamscore
Hello
Moz Tools | | serktba
How can I reduce the spamscore on my website?
All the activities I did on my website were completely white hat and I did not do any spam jobs, but my spam score is 2%
This is my site address
https://abedinigroup.com/
Please help me how can I reduce the spamscore in my account?3 -
Unsolved Domain Authority Not Changed?
The domain authority has not changed for a few months; even I got some high-quality links from authority sites, and Moz has not crawled them yet? Can someone tell me how much time it generally Moz takes to crawl new links for a domain and update DA?
Moz Tools | | peaceforchange00
My domain is https://thebookspdf.net/6 -
Unsolved Why Moz shutdown on seprate website ?
My moz shutdown on some website like my website -
Moz Tools | | yuvrajsindhal
https://shotsblastingmachine.com/0 -
Unsolved error in crawling
hello moz . my site is papion shopping but when i start to add it an error appears that it cant gather any data in moz!! what can i do>???
Moz Tools | | valigholami13860