Its been over a month, rogerbot hasn't crawled the entire website yet. Any ideas?
-
Rogerbot has stopped crawling the website at 308 pages past week and has not crawled the website with over 1000+ pages. Any ideas on what I can do to get this fixed & crawling?
-
Hi TJ,
Did that answer your question? if so I am very happy. Please let me know if there's anything else I can do to assist you in fully answering this question. thank you for the kind words.
Happy holidays,
Thomas
-
@Thomas
Thanks for the headsup! Ever since asking this question Roger has crawled 2 more pages taking the total to - 310.
Yes, I've already selected Roger send details on the site on a weekly basis via the reporting section. Thanks for the quick reply and happy holidays!
Best,
TJ
-
If you have a stop at 308 that is normal Roger likes to take breaks or smaller amounts of websites in the beginning only indexes he will be back way to make sure is by following the directions below.
Have you requested that Roger check your site by going into campaigns then selecting reports then selecting weekly?
Make sure the above steps of been done. Roger is going to town on mine so I don't think you leave you out of the party.
Respectfully,
Thomas Zickell
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What is the best way to increase the DA and PA of website?
Hello, I hope everybody is fine. I am looking for a right way to increase the DA and PA of the website and its webpage. I have a lesco duplicate bill info related webpage which I want to increase the PA. Kindly guys guide me the legit way of increasing the Page Authority. Thanks
Moz Pro | | rankvizguru1 -
Moz and HubSpot SSL - crawl error?
I'm getting an error message when Moz tries to crawl my site, however when I check in Google Search Console, they return no errors. Our site is hosted on HubSpot. Is Moz still having trouble crawling HubSpot sites that have enabled their SSL? I read an article that this should have been corrected in early 2017, but I'm getting an error.
Moz Pro | | jennygriffin0 -
Root domain or 'www' subdomain for campaigns?
I am setting up a campaign and I am unsure whether I should specify the root domain (prohibitionhats.co.nz) or the 'www' subdomain (www.prohibitionhats.co.nz). Are there any guidelines for this or will Moz automatically aggregate the data for both irrespective of the domain you choose? Thanks Laurie
Moz Pro | | turnbullholdingsltd0 -
My website was hacked last Thursday
My business website was hacked (for the 2nd time in 12 months) last Thursday and all data lost. I've been rebuilding the site and database since then but I'm still getting Hacking Warnings each day. The latest warning says: Dear Colin/Administrator,
Moz Pro | | NileCruises
Someone has attempted to inject SQL into your domain:
HACK DETECTED!
PHP TYPE
IP: 94.100.17.134
Scriptname: /index.cfm
PathInfo: /index.cfm
QueryString: src=http%3A%2F%2Fpicasa.com.oprst.in%2Fshow.php%3Fid%3D16907217 My Technical advisro tells me the IP address is that of Inferno Solutions of The Netherlands. I wonder if anyone has suffered hacking like this what steps they too and what I could do about the potential hackers? Colin0 -
Here's a hard one! Why isn't my profile picture displaying as an avatar iin forums and blogs?
My profile pic is updated and displays on my profile but I still have the default avatar beside all forum and blog posts... This is life or death... I must know the answer. 😉 Thanks guys.
Moz Pro | | Anthony_NorthSEO0 -
Why doesn't Open Site Explorer recognize the link from my twitter profile?
When I run a report on my competition I'm seeing their link show up in OSE's report under the "Linking Domains" tab, but when I put my site in there, it doesn't recognize my link from my twitter profile. Any ideas?
Moz Pro | | shawn811 -
My 2 Target Keywords Rank In Top 10 But Don't Show Up...?
Hi, My 2 target keywords definitely rank in the top 10 in the USA version of Google but they dont show up in SEOMOZ rank checker...I started using SEOMOZ abour a week or so ago and in 2 consecutaive ranking checks they haven't shown up... Market Samurai says they're 4 and 8 respectively, I can see them in the top 10 of Google and various USA proxies show they're in the top 10... Is there a glitch with SEOMOZ or am I doing something wrong? Thanks, James
Moz Pro | | James10 -
Canonical tags and SEOmoz crawls
Hi there. Recently, we've made some changes to http://www.gear-zone.co.uk/ to implement canonical tags to some dynamically generated pages to stop duplicate content issues. Previously, these were blocked with robots.txt. In Webmaster Tools, everything looks great - pages crawled has shot up, and overall traffic and sales has seen a positive increase. However the SEOmoz crawl report is now showing a huge increase in duplicate content issues. What I'd like to know is whether SEOmoz registers a canonical tag as preventing a piece of duplicate content, or just adds to it the notices report. That is, if I have 10 pages of duplicate content all with correct canonical tags, will I still see 10 errors in the crawl, but also 10 notices showing a canonical has been found? Or, should it be 0 duplicate content errors, but 10 notices of canonicals? I know it's a small point, but it could potentially have a big difference. Thanks!
Moz Pro | | neooptic0