+1 We must also use another service if Moz cannot fix their crawler issues. Roger should be one of the best bots out there for what Moz charges. Come to find out it's built on an ancient Python version and needs to be completely rewritten.
Posts made by kent.dagnall
-
RE: Does Rogerbot support SNI? - And if not All sites behind Cloudflare are probably uncrawlable.posted in Feature Requests