Rogerbot not showing in logs
-
Hi All
Rogerbot has recently thrown up 403 errors for all our pages - no changes had been made to the site so I asked our ISP for assistance.
They wanted to have a look at what rogerbot was doing and so went to the logs but rogerbot was not listed anywhere in the logs by name - any ideas why?
Regards
Craig
-
Hey Craig,
Sorry about the issues you are experiencing with the crawler. I just opened up a customer support ticket for you so we can investigate this on our end to see what's going wrong.
My apologies for the inconvenience!
Kenny
-
Have you performed a crawl test? That might give you a clearer idea of what's going on.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Keyword Ranking Report: does the organic traffic data take into account visitors logged into Google?
Hi there In Google Analytics, if a visitor to your website is logged into Google at the time of searching, the referral keyword is registered as 'unknown'. So, I am curious as to how the traffic data for any given keyword in my campaign is calculated? Thanks Laurie
Moz Pro | | turnbullholdingsltd1 -
Quarterly Reports Show Odd Data
I've pulled a quarterly report for a client, and it's showing very odd numbers. I'm monitoring 58 keywords - and the current keyword ranking report from last week says that there are 21 keywords in the top 3 and 33 on the first page. But the quarterly report says that there are 50 in the top 3 and 70 on the first page??? What's up with this?
Moz Pro | | Bigheadigital0 -
Why does Rel Canonical show up as a notice?
In the crawl diagnostics screen "Rel Canonical" shows up as a notice for every page that has a rel="canonical" meta tag in it. Why is this the case? Shouldn't every page have a canonical tag on it to show the absolute URL to the content? Wouldn't a better notice be to display pages that do not have a canonical tag instead? I could be wrong but that would make more sense to me. (In fact.. let's be honest here.. I probably am wrong.. but I'd like someone to explain it if they could.) Thanks
Moz Pro | | rrolfe1 -
Duplicate pages with canonical links still show as errors
On our CMS, there are duplicate pages such as /news, /news/, /news?page=1, /news/?page=1. From an SEO perspective, I'm not too worried, because I guess Google is pretty capable of sorting this out, but to be on the safe side, I've added canonical links. /news itself has no link, but all the other variants have links to "/news". (And if you go wild and add a bunch of random meaningless parameters, creating /news/?page=1&jim=jam&foo=bar&this=that, we will laugh at you and generate a canonical link back to "/news". We're clever like that.) So far so good. And everything appears to work fine. But SEOMoz is still flagging up errors about duplicate titles and duplicate content. If you click in, you'll see a "Note" on each error, showing that SEOMoz has found the canonical link. So SEOMoz knows the duplication isn't a problem, as we're using canonical links exactly the way they're supposed to be used, and yet is still flagging it as an error. Is this something I should be concerned about, or is it just a bug in SEOMoz?
Moz Pro | | LockyDotser0 -
Link not showing up in OSE
I created a profile in April this year on CrunchBase for my company http://www.crunchbase.com/company/wallpapered but it is not appearing in the "inbound links" of Open Site Explorer. All the other companies I have checked in OSE have their CrunchBase profile in their inbound links (many share the same Page authority as mine). Any suggestions would be really helpful. Thanks
Moz Pro | | roberthseo0 -
Why is open site explorer not showing the top links that if found previously.
In previous months ago open site explorer listed many other sites linking to mine. I have checked those sites and they are still linking to my site. Why doesn't open site explorer list them?
Moz Pro | | call4help0 -
In competitive domain analysis my website shows pages that I no longer have.
When I go to my campaign, link analysis, under competitive comparison/followed backlinks, the 5 pages under Anchor Text/Target URL, supposedly on my website, are not on my website anymore. I recently moved my domain name to another server (before signing up for seomoz) and deleted the forum associated with my website. Those 5 pages are all from that now extinct forum. What's going on?
Moz Pro | | ovistomih0 -
Why doesn't the BBB / Trustlink.org links show up in the Link Analysis?
I am curious why one of my client's main competitors (www.allbayhardwood.com) shows links from the Better Business Bureau and Trustlink.org (associated with BBB) but links from those sources do not show up for his domain (www.sanjosehardwoodfloors.com). He has been a BBB Acredited Business since 12/2010 and on file with them for probably as long as they have had the online version, which seems like plenty of time for the link to have been picked up. BBB has a very nice domain authority and it would be great to see these links show up. (they don't show up in webmaster tools either) Is there something I am missing? Thanks in advance guys and gals! (I know the site has other SEO issues - just getting started on pounding everything out.)
Moz Pro | | SnoBaer0