Crawl test limitaton - ways to take advantage of large sites?
-
Hello
I have a large site (120,000+) and crawl test is limited to 3,000 pages.
I want to know if you have a way to take advantage to crawl a type of this sites. Can i do a regular expression for example?
Thanks!
-
Hi there. Kristina from Moz's Help Team here.
The Crawl Test tool is limited to only 3,000 pages by design as the full Site Crawl that happens within your campaign(s) is a much larger, weekly crawl that occurs.
All Moz Pro Standard & Medium subscription levels (you currently have access to a Standard account) default all Site Crawls within a Campaign at a max of 50,000 pages. If you're interested in crawling more than 50,000 pages within a single Campaign, it would require subscribing to a higher subscription.
You can view all of our subscription plans on our pricing page here: https://moz.com/products/pro/pricing
As always, you can reach out to our team in the future with product questions such as this one by either emailing help@moz.com or clicking on the blue chat box on the lower right hand corner of your screen while in the product itself.
I hope this helps but please let me know if there's anything else I can assist with!
Thank you,
-Kristina
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can Moz add an alert to email us when a competitor's site gets a new backlink?
This would be a very useful feature, and other sites are doing this, including Ahrefs.
Feature Requests | | rabbit5190 -
Moz crawler is not able to crawl my website
Hello All, I'm facing an issue with the MOZ Crawler. Every time it crawls my website , there will be an error message saying " **Moz was unable to crawl your site on Sep 13, 2017. **Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. " We changed the robots.txt file and checked it . but still the issue is not resolved. URL : https://www.khadination.shop/robots.txt Do let me know what went wrong and wjhat needs to be done. Any suggestion is appreciated. Thank you.
Feature Requests | | Harini.M0 -
Is there a way to turn off Meta Noindex warnings?
My site is Wordpress, and indexing tags, categories, dates, etc. just ends up causing potential duplicate page content, and so using the advised SEO Yoast plug in suggestion, we have set those type listings to noindex. However now MOZ flags me with 1.7k+ noindex warnings. I know it is not hurting anything, but is there anyway to disable that warning to clean up my crawl error report?
Feature Requests | | OBIAnalytics1 -
Is there any way to filter by relevancy first and then volume second? Right now I just export the results of keyword explorer and do it offline. It would be great if I could do it online
I'm trying to filter the results of a keyword search in keyword explorer by relevancy first and volume second. But the minute I select volume the relevancy is completely lost. I know I can export them and manipulate it in excel but is there a feature that allows me to do this in Moz?
Feature Requests | | Anerudh0 -
Crawl error : 804 https (SSL) error
Hi, I have a crawl error in my report : 804 : HTTPS (SSL) error encountered when requesting page. I check all pages and database to fix wrong url http->https but this one persist. Do you have any ideas, how can i fix it ? Thanks website : https://ilovemypopotin.fr/
Feature Requests | | Sitiodev0 -
Does moz offer a site auditor tool to imbed on your website?
similar service as http://mysiteauditor.com. just want to embed a tool on our website that allows the visitor to enter their url and have a report emailed to them.
Feature Requests | | WebMarkets1 -
Migrate campaign from when site changes from http:// to https://
We moved from our site from http:// to https://, redirecting all traffic to the new https connection. However, in our campaign all scores have dropped (only 1 page crawled). Is there something we can do to migratie the data, or update the existing campaign to reflect this minor change to our existing site?
Feature Requests | | BentoPres0