Crawl Issue
-
Hi,
We have 3 campaigns running for our websites in different territories. All was going well until April 11th when Moz reported that our .com site (sendmode.com) could not be crawled. I get this error "Your page redirects or links to a page that is outside of the scope of your campaign settings ..."
I've been through the site a number of times but have been unable to get to the root of the problem. Robots.txt and 301's look fine.
Is there any way I can find out which page is causing the issue?
John
-
No problem
-
Thanks so much for the response Eli. Will have a look at that last page.
-
Hey John,
Thanks for reaching out to us!
Please could you write into us at help@moz.com so we can look into your Campaign and get to the bottom of this?
P.S. The way to see which page our crawler is stopping at would be to head to the 'All Crawled Pages' section of your Campaign (under Site crawl) and export the CSV. You will be able to see the order in which our crawler has crawled your site, and the last page is the page we have stopped at.
Looking forward to hearing from you,
Eli
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Performance Metrics crawl error
I am getting an error:
Product Support | | bhsiao 0
Crawl Error for mobile & desktop page crawl - The page returned a 4xx; Lighthouse could not analyze this page.
I have Lighthouse whitelisted, is there any other site I need to whitelist? Anything else I need to do in Cloudflare or Datadome to allow this tool to work?1 -
Website can't be crawled
Hi there, One of our website can't be crawled. We did get the error emails from you (Moz) but we can't find the solution. Can you please help me? Thanks, Tamara
Product Support | | Yenlo0 -
Subscription Billing Issues
Hi,I was testing out the medium pro features but was not aware that I had passed the 30day trial period and there was no notification or email sent to me informing me that. It was shocking to have been billed such a huge amount. Is it possible to get a refund? You can check my activity log which will be inactive.
Product Support | | Aquasips0 -
Crawl still in process for 3 days. Not sure why the site isn't being crawled
I added a new site to the crawl, but it seems to be stalled. It was supposed to crawl Feb 19, but it is still in process Feb 22. It tried to crawl the site and there was a robots.txt issue, but that issue was resolved way before the 19th. Not sure what is going on. this is for the clear lake campaign.
Product Support | | dpsoftware0 -
Rogerbot not crawling our site
Has anyone else had issues with Roger crawling your site in the last few weeks? It shows only 2 pages crawled. I was able to crawl the site using Screaming Frog with no problem and we are not specifically blocking Roger via robots.txt or any other method. Has anyone encountered this issue? Any suggestions?
Product Support | | cckapow0 -
I have removed a subdomain from my main domain. We have stopped the subdomain completely. However the crawl still shows the error for that sub-domain. How to remove the same from crawl reports.
Earlier I had a forum as sub-domain and was mentioned in my main domain. However i have now discontinued the forum and have removed all the links and mention of the forum from my main domain. But the crawler still shows error for the sub-domain. How to make the crawler issues clean or delete the irrelevant crawl issues. I dont have the forum now and no links at the main site, bu still shows crawl errors for the forum which doesnt exist.
Product Support | | potterharry0 -
Reports Issues
Hello there, I recently re-activated my account and I have some issues with the reports. I have been notified by email that the crawl has been successful and data were collected but they refer to January and February instead of November. What should I do? Thanks
Product Support | | PremioOscar0 -
New Campaign Set Up Completion/finishing issue !?
Hi I have just completed setting up a new campaign in Moz Analytics but when i press finish theres a graphic representing somehting updating/loading and then nothing happens like a message saying campaign set up complete and it just stays on same page. Does that mean its set up or theres a problem ? Cheers Dan
Product Support | | Dan-Lawrence0