Crawl Issue
-
Hi,
We have 3 campaigns running for our websites in different territories. All was going well until April 11th when Moz reported that our .com site (sendmode.com) could not be crawled. I get this error "Your page redirects or links to a page that is outside of the scope of your campaign settings ..."
I've been through the site a number of times but have been unable to get to the root of the problem. Robots.txt and 301's look fine.
Is there any way I can find out which page is causing the issue?
John
-
No problem
-
Thanks so much for the response Eli. Will have a look at that last page.
-
Hey John,
Thanks for reaching out to us!
Please could you write into us at help@moz.com so we can look into your Campaign and get to the bottom of this?
P.S. The way to see which page our crawler is stopping at would be to head to the 'All Crawled Pages' section of your Campaign (under Site crawl) and export the CSV. You will be able to see the order in which our crawler has crawled your site, and the last page is the page we have stopped at.
Looking forward to hearing from you,
Eli
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz crawler not crawling on my site
Hi all, im facing an issue where moz crawler is unable to crawl my site. The following error keeps showing Our crawler was banned by a page on your site, either through your robots.txt, the X-Robots-Tag HTTP header, or the meta robots tag. This is my robots.txt file : https://www.wearefutureheads.com/robots.txt I'm not sure what else am I missing.. can anyone help
Product Support | | teikh0 -
Crawl error robots.txt
Hello, when trying to access the site crawl to be able to analyze our page, the following error appears: **Moz was unable to crawl your site on Nov 15, 2017. **Our crawler was banned by a page on your site, either through your robots.txt, the X-Robots-Tag HTTP header, or the meta robots tag. Update these tags to allow your page and the rest of your site to be crawled. If this error is found on any page on your site, it prevents our crawler (and some search engines) from crawling the rest of your site. Typically errors like this should be investigated and fixed by the site webmaster. Can help us? Thanks!
Product Support | | Mandiram0 -
Moz has stopped crawling my site
Hello, We have been using Moz Pro for over a year on our site and in the last month noticed that our site is not being crawled anymore. I took a look in Google Search Console, and everything seems to be fine there, so I think it is just the Moz tool that is not working. Has anyone else experienced this? Are there any tips for troubleshooting it? Thank you, Adam
Product Support | | cwells0 -
Moz Local support -- please address our dashboard issues.
We are experiencing issues with two client locations for Hillcrest. Hillcrest Home Care and Hillcrest Hospice Care. The Hospice Care location is displaying as Home Care, and one of the duplicate Home Cares is saying it is paused. This might be due to the fact that Google flagged Hospice Care as a duplicate of Home Care, because they are at the same address but have different suite numbers. Please help ASAP. Thanks.
Product Support | | LM360_Digital0 -
No crawl data anymore
Using moz quite some time, but I don't have any crawl data anymore. What happened? (www.kbc.be)
Product Support | | KBC
http://analytics.moz.com/settings/campaign/517920.11285160 -
Crawl errors are still shown after fixed
Fixed long ago "title too long" and some 404 errors, but still keep on showing on error statistics
Product Support | | sws10 -
Reports Issues
Hello there, I recently re-activated my account and I have some issues with the reports. I have been notified by email that the crawl has been successful and data were collected but they refer to January and February instead of November. What should I do? Thanks
Product Support | | PremioOscar0 -
Issues with Page Grader Tool and competitor KW Rankings
I'm having two very frustrating issues with Moz: The page grader tool is not 'connecting' the correct keyword with the correct URL. For instance, if I want to rank for Dallas Motorcycle Accident Lawyer and create page of optimized content at Dallas.Zdfirm.com/Motorcycle-Accident, Moz doesn't grade THAT page. It grades Dallas.ZDFirm.com which to no surprise rates as an F. This is happening with both web sites on this account so much that the page grader tool is not delivering any value. My competitors keywords are not tracking properly. They are showing for "not in the top 50" for keywords that they are on the first page for. Again, this is for both domains on this account. Thanks, Brian
Product Support | | ZDAdmin0