Its been over a month, rogerbot hasn't crawled the entire website yet. Any ideas?
-
Rogerbot has stopped crawling the website at 308 pages past week and has not crawled the website with over 1000+ pages. Any ideas on what I can do to get this fixed & crawling?
-
Hi TJ,
Did that answer your question? if so I am very happy. Please let me know if there's anything else I can do to assist you in fully answering this question. thank you for the kind words.
Happy holidays,
Thomas
-
@Thomas
Thanks for the headsup! Ever since asking this question Roger has crawled 2 more pages taking the total to - 310.
Yes, I've already selected Roger send details on the site on a weekly basis via the reporting section. Thanks for the quick reply and happy holidays!
Best,
TJ
-
If you have a stop at 308 that is normal Roger likes to take breaks or smaller amounts of websites in the beginning only indexes he will be back way to make sure is by following the directions below.
Have you requested that Roger check your site by going into campaigns then selecting reports then selecting weekly?
Make sure the above steps of been done. Roger is going to town on mine so I don't think you leave you out of the party.
Respectfully,
Thomas Zickell
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz isn't recognizing content on our website hosted on bubble.is
Hi all. We have a bubble.is site and it's difficult to get Moz to recognize the text on the site (even though Google seems to recognize it most of the time). The pages are recognized...just not the text. **In case you want to play around: ** https:getmarlow.com/about https://getmarlow.com/article/gather-data-on-where-your-time-and-energy-go-1579415891021x868278876529492000
Moz Pro | | Marlow20 -
Is a new website the only way to get better rankings?
Our website is https://www.franklin-bell.com.au. For a while now we've been trying to get a few of our pages on there to get a better rank on google. A local SEO agency told us that some of our pages are not like "the modern standard" for web pages, but our page score for the keywords we want is 90% and higher. Do we really need to completely rebuild the website (it was built in 2014) in order to get better rankings? Or is it sufficient to have the 97% page score and then just get some back links and social media referrals etc. Thanks in advance.
Moz Pro | | franklin-bell0 -
New Website & DA Score
We are preparing to build a new website for a branch of our company. According to Neil Patel (whom I highly respect) our DA should come in around 30 (categorizing us as a startup, see chart below). So I ask: Why do our current sites DA Score below 30? (20 & 29 respectively) Our sites were redesigned in 2013 and are responsive, pass the Google Mobile Friendly test and I've improved load speed by over 25% by compressing images. I have used Moz as guidance for 10 months on both 7 + yo sites, HP.com is 14 yo, our pages score in the high 90's and I have disavowed bad backlinks for 6 months (now only every other month). I thought we would be in or close to the 50 range by 2017 after a solid year of improvements, but I don't see that happening. Our scores go up a point or two, then back down, we have floundered 2 points either way for 10 months. Most important question: What do I do now to raise our DA? Lastly, my plan is to take all the lessons learned from the past years and apply it to the new site, measure the success and then redesign the other two sites in accordance to the new model. But that may be a year away. KJr www.heritageprinting.com www.heritageprintingcharlotte.com | DA | Rating |
Moz Pro | | KevnJr
| 1-10 | Poor – Your site is young and weak. You have a lot of growing to do. |
| 11-20 | Decent. Your site isn’t stellar, but you’re doing better. It would be good to grow. |
| 21-30 | Fair. Your site shows signs of SEO, but there are many things you can and should do to improve. |
| 31-40 | Competitive. A lot of startups find themselves in this DA range. It’s not bad, and you’re beginning to get close to the sweet spot. |
| 41-50 | Good. Now, you’re getting somewhere. This is a nice place to be, and many good e-commerce sites find themselves squarely in this category. |
| 51-60 | Strong. As you swing out of the lower half of the scale, you’re beginning to get much healthier. This is a good place to be. |
| 61-70 | Excellent. A DA at this level represents a great site with a lot of recognition, a lot of link backs, and a considerable authority in its niche. Many .edus are in this space. |
| 71-80 | Outstanding. You’re dominating in the SERPs and owning your niche. Quick Sprout is a 73. |
| 81-90 | Very outstanding. You’re in the upper echelons of authority. You can consider yourself to have arrived. |
| 91-100 | Rare. These sites are household names — Wikipedia, Facebook, New York Times, etc. Your site will probably never attain this level. Only a miniscule fraction of a percentage of sites on the Internet ever get this high. | https://www.quicksprout.com/2014/04/09/how-to-score-your-websites-seo-in-10-minutes-or-less/0 -
What is the best free 'contact finder' tool?
What is the best free 'contact finder' tool? By contact finder I mean a tool that can search multiple websites and display the contact details of each site. Why do Moz not provide such a tool? Thanks
Moz Pro | | conor10050 -
Can I see when SEO Moz has crawled my website?
I would like to know if it's possible to see (maybe in my Google Analytics) if SEO Moz has crawled my website. I'm also curious if and where I can see when the robot of Google visited my website. Thanks!
Moz Pro | | Spotler0 -
Why don't Google+ URL's work in OSE?
Is there any reason why Google+ URLs does not work in OSE? Is it just that it is a secure URL or is there something bigger there? Why? Be cool to determine every website the person has been published on; especially if it is rel="author" verified. Jeff
Moz Pro | | WebBizIdeas1 -
How long is a full crawl?
It's been now over 3 days that the dashboard for one of our campaigns shows "Next Crawl in Progress!". I am not complaining about the length... but I have to agree that SEOMoz is quite addictive, and it's quite frustrating to see that everyday 🙂 Thanks
Moz Pro | | jgenesto0