Moz Crawl Test Tool - SEO Web Crawler showing up with no details
-
So basically I have ran the Moz Crawl Test tool twice for this url "bubblingwithenergy.info" and both times the report has listed 1 URL when there is obviously a lot more if you check the site.
My question is, why is the Moz Crawl only reporting 1 URL when there are heaps? Is there a possibility it is being blocked and if so what would be blocking it?
This website is using a CMS called Infusion and it is based off CMSMS (CMS Made Simple).
Any answers would be greatly appreciated.
Cheers
-
Glad I could help!
-
Thanks Chiaryn, I hadn't noticed the site not being canonicalized.
I'll fix now and try again
-
Hey There,
I took a look at your site and it would seem that all of the links on the page bubblingwithenergy.info actually lead to pages on the www.bubblingwithenergy.info subdomain. Unfortunately, our crawl test tool only tracks sites at the subdomain level, so you would need run the crawl test for www.bubblingwithenergy.info to get a full crawl of the site.
I hope this helps! Please let me know if you need any further assistance with your crawl test.
Chiaryn
-
Our help desk can take a closer look and give you more details. In the meantime, here's a page that gives common reasons why we're only able to crawl a single page.
http://moz.com/help/guides/search-overview/crawl-diagnostics/rogerbot
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I bought a domain name ez1.in and it has high MOZ spam score. Althought i
I bought a domain name https://ez1.in and it has a high MOZ spam score. Although it is because of the previous webmaster who used this domain as a URL shortening website. But now I am using it as a service delivery website. I wanted to know once a domain is deleted and ready to resell MOZ doesn't update its Spam score? Or it has periodic updates that are scheduled? How does the whole process work?
Moz Bar | | vadir9690 -
Why is on-demand crawl reporting numbers that are very different than the regualr site crawl by Moz?
When I look at the site crawl available through my dashboard, it reports 22.9K pages crawled. I just ran a on-demand crawl and it is only reporting 6K pages crawled. Why is the number so much lower?
Moz Bar | | ctripp10100 -
Limit MOZ crawl rate on Shopify or when you don't have access to robots.txt
Hello. I'm wondering if there is a way to control the crawl rate of MOZ on our site. It is hosted on Shopify which does not allow any kind of control over the robots.txt file to add a rule like this: User-Agent: rogerbot Crawl-Delay: 5 Due to this, we get a lot of 430 error codes -mainly on our products- and this certainly would prevent MOZ from getting the full picture of our shop. Can we rely on MOZ's data when critical pages are not being crawled due to 430 errors? Is there any alternative to fix this? Thanks
Moz Bar | | AllAboutShapewear2 -
Http:// https:// google search console crawl errors
How to direct http:// to https:// to get rid of 404 errors in google webmaster search console (http:// crawl errors)
Moz Bar | | O.D.0 -
Is Keyword Difficulty tool algorithm changed ?
I'm very confused about this. From today, I realized that your algorithm for this tool changed. For example, I have search KC for this keyword before: suitcases for kids has KC is 23. But today I checked it again and it's 43. How can I deal with this new data? Is KC is good for determine that a keyword is easy to rank for ?
Moz Bar | | trungbq060 -
Moz crawl sees meta description but there are none
I have a new site I have run a starter crawl on. The crawl came back saying some of the pages do indeed have meta descriptions. When I go to the same page and use the Moz Chrome toolbar it says they do not have meta descriptions. I also know they do not have meta descriptions. Are there any instances in which the Moz crawler would see them when they are not there?
Moz Bar | | SBXMedia0 -
Why still the moz index showing "Next Update on August 26, 2013"?
I have been waiting to see the updated authority metrics from Opensiteexplorer.org. But still it is showing old data. and showing "next index update: August 26, 2013" as the date is 27th August today. Is there any delay in update?
Moz Bar | | Bala_K2