Crawl test tool from SEOmoz - which URLs does it actually crawl?
-
I am using for the first time the crawl test tool from SEOmoz and I do not really understand which URLs the tool is going to crawl.
First, it says "enter any subdomain" --> why can´t I do the crawl for the root domain?
Second it says "we'll crawl up to 3,000 linked-to pages" --> does that mean that the tool crawls all internal links that it can find on the given domain?
Thanks for your help!
-
Hi Elke,
An initial Pro campaign will take up to 7 days to complete and will crawl up to a maximum 10,000 URLs for the root domain or sub domain that you choose to set it up for.
The Crawl Test tool is intended to provide a "quick start " option, which will report against the same diagnostic information, but for a limited number of URLs (3,000 & max of 2 domains per day). This allows you to get started on tidying up site issues while waiting for the full crawl to complete.
Since the Crawl Test tool allows you to run the quick crawl for any subdomain, it can also be useful for taking a look at the health of established sites you may be quoting on etc.
Hope that helps,
Sha
-
Alan, thank you for the answer. I am a Pro Member (trial version). But the only crawl diagnostics that I can find inside my campaign is a short Crawl Diagnostics summary which doesn´t include all the information that the crawl test tool gave me... I have just set up a campaign for the root domain, let´s see if the crawl diagnostics give me more information for that one.
-
When you become a pro meneber you can set up compaigns, then you can set up by root domain and crawl all sub domains.
the free version will crawl only one sudomain, such as
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Are there any free (or paid) tools available online that download Meta Tags for ALL URL's of a website?
Hi, I am looking to run an On-Site audit for a website and I'm wondering if there are any tools available online that take the existing Meta Tags on ALL pages of a website and downloads them to a .CSV or .XLS. Would need Meta Title and Meta Description for all pages at the very least. Any suggestions are appreciated - looking for Free or Paid options. Thanks.
Moz Pro | | SEO5Team0 -
Crawl test from tools
Hi, I notice that the crawl test which is from the Research Tools doesn't really get a new crawl even though there is 2 crawl per day. It will only provide the data which was acquire from the crawl diagnostics in my pro account. There is no point for me to get the data which I get from my crawl diagnostic isn't it? Even seomoz provided with more than 2 crawl per day also useless in this case. This whole thing doesn't make sense as the crawl diagnostics will only perform a full crawl test once every week. but even the crawl test also not helping any thing out for me.
Moz Pro | | hanzoz0 -
Why is SEOmoz link tagged with a (nofollow) for my site? I have tried to write a youmoz post a couple of times. But, I am just not an expert, that is why I am on SEOmoz.
Why is SEOmoz link tagged with a (nofollow) for my site? I have tried to write a youmoz post a couple of times. But, I am just not an expert, that is why I am on SEOmoz. Is there something I can do to get juice from my SEOmoz account? (nofollow) Scott McNelley, President: Admiral Movers, Admi... www.seomoz.org/users/profile/423056
Moz Pro | | Smcnelley0 -
Question #3) My last question has to do with Some SEOmoz crawl diagnostics -
I recently fixed (or well, I am asking to make sure that this was the right thing to do in my first question posted a few minutes ago), a problem where all of my internal main sidebar category pages were linking using https://, which to my knowledge means SECURE pages. anyways, OSE, and google seem to be not recognizing the link juice. but my rank fell for one of my main keywords by 2 positions about a week after i made the fix to have the pages be indexable. Making my pages properly linked can't be a bad thing right? That's what I said. So I looked deeper, and my crawl diagnostics reports showed a MASSIVE reduction in warnings (about 3,000 301 redirects were removed by changing the https:// to http:// because all the secure pages were re-directing to http:// regular structure) and an INCREASE, in Duplicate Page Titles, and Temporary redirects... Could that have been the reason the rank dropped? I think I am going to fix all the Duplicate Page Title problems tonight, but still, I am a little confused as to why such a major fix didn't help and appeared to hurt me. I feel like it hurt the rank, not because of what I did, but because what I did caused a few extra re-directs, and opened the doors for the search engine to discover more pages that had problems (which could have triggered an algo that says hey, these people have to much duplicate problems) Any thoughts will be GREATLY appreciated thumbed, thanked, and marked as best answers! Thanks in advance for your time, Tyler A.
Moz Pro | | TylerAbernethy0 -
Not all pages are being crawled
I am set up on the PRO plan, I was under the impression that it would crawl up to 10,000 pages. My site has just over 200 pages, but whenever I am crawled it only crawls 121 pages. Is this normal? It's hard to know how reliable my data is because a significant amount of pages are missing.
Moz Pro | | KristinHarding0 -
Keyword Difficulty Tool not workin
Keyword Difficulty Tool has been down for two weeks, customer help does not reply to my emails, whats going on SEOmoz? the customer service used to be much better.
Moz Pro | | Thommas0 -
How long is a full crawl?
It's been now over 3 days that the dashboard for one of our campaigns shows "Next Crawl in Progress!". I am not complaining about the length... but I have to agree that SEOMoz is quite addictive, and it's quite frustrating to see that everyday 🙂 Thanks
Moz Pro | | jgenesto0