Rogerbot not showing in logs
-
Hi All
Rogerbot has recently thrown up 403 errors for all our pages - no changes had been made to the site so I asked our ISP for assistance.
They wanted to have a look at what rogerbot was doing and so went to the logs but rogerbot was not listed anywhere in the logs by name - any ideas why?
Regards
Craig
-
Hey Craig,
Sorry about the issues you are experiencing with the crawler. I just opened up a customer support ticket for you so we can investigate this on our end to see what's going wrong.
My apologies for the inconvenience!
Kenny
-
Have you performed a crawl test? That might give you a clearer idea of what's going on.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why does a word show as 'Google en-US Mobile Friendly' = FALSE when it also shows that it ranks 3 on mobile?
I pulled a recent report for all words I'm tracking locally and it states that a specific term ranks #4 on desktop and #3 on mobile. But in separate columns, specifically "Google en-US Mobile Friendly" that same terms shows as 'FALSE'. Any idea what this means? Thanks!
Moz Pro | | KristinaWitmer0 -
Canonical URLs all show trailing slash on main site pages - using Yoast SEO for Wordpress - how to correct
We are using Yoast for a number of our sites. We use naked domain as the canonical. I have noticed in the header tags that all our sites show the canonical URLs as having a trailing slash: Example: http;//foxspizzajc.com, when I look at the source code, it shows the canonical as http;//foxspizzajc.com/ Of course, it is much more likely that all sites that link to us will not use the trailing slash - so preferably we do not want that to be the canonical - among other reasons. Does this need to be fixed so the trailing slash is removed? I cannot see how to do this in Yoast SEO or in Permalinks structure for Wordpress. Sorry for my ignorance. Thanks for any help.
Moz Pro | | Adam_RushHour_Marketing1 -
I have a client with a bit over 100 inbound links but Open Site Explorer shows total links on Subdomain as over 66,000, how can this be?
I have a client www.woodard247.com that shows only a bit over 100 inbound links. using the Open Site Explorer, they are a well trafficed local site and are not doing any grey hat or black hat techniques. However the rankings for their main keywords have suffered recently and we cannot identify any duplicate content or keyword stuffing issues. We have never purchased links or used link building software. Now for the main question: When we run Open Site Explorer it shows only a bit over 100 inbound links on the page and the domain, but the subdomain shows over 66,000 total links! How can this be possible? Could this be a problem? How can I find out what these links are since Open Site Explorer and Seo Spyglass both show only a hundred or so?
Moz Pro | | tjkirgin0 -
Opensite explorer not showing facebook/twitter other sites
hello i have had my site live and indexing for 3 months however open site explorer doesn't show the facebook or twitter linkback from my corporate sites. any ideas why this would not show in opesite? it doesn't show in google WMT either. my site: http://cheap-airport-taxis.com/
Moz Pro | | smashseo0 -
Why not having on SEOmoz pro dashboard the table shows by rand fishkin in his whiteboard friday (see below)
I have seen this video, very interesting. Why not building this keyword dashboard in SEOmoz as all data can be taken from Google Analytics ? http://www.seomoz.org/blog/keyword-metrics-for-seo-and-driving-actions-from-data-whiteboard-friday
Moz Pro | | betadvisor0 -
Why does open site explorer show me Chinese characters?
Hi there, When using open site explorer to check the anchor text for www.bookvictoriafalls.com I see Chinese characters as anchor text. However, when I do the same for www.bookvictoriafalls.com/ I see normal English anchor text. Coincidentally this domain has dropped from first page rankings to outside the top 50. Is this a spam issue? Open-Site-Explorer.png
Moz Pro | | Robbern0 -
My Campaign just picked up the .com.au site and is showing data
I've got a campaign set up here in SEOmoz and it appears that it just started picking up data for a site that is not mine. Our site is examplesite.com and i noticed that SEOmoz has begun including examplesite.com.au and is showing 20,000 302's from this site. The .com.au site is in no way related to our business and should not be tracked in our campaign. Has this happened to anyone else?
Moz Pro | | WP_SEO0 -
Will Open Site Explorer ever show number of links over time?
OSE is an amazing tool, but do you guys at SEOmoz have any plans to develop it so we can track numbers of links over time. I need to demonstrate to clients how the link building is going, and this would be a great quick report to see how many links you found on a given day, month, year, etc. A bit like magesticSEO backlink history graph, but better 🙂
Moz Pro | | timwills0