Crawl test from tools
-
Hi,
I notice that the crawl test which is from the Research Tools doesn't really get a new crawl even though there is 2 crawl per day. It will only provide the data which was acquire from the crawl diagnostics in my pro account. There is no point for me to get the data which I get from my crawl diagnostic isn't it? Even seomoz provided with more than 2 crawl per day also useless in this case.
This whole thing doesn't make sense as the crawl diagnostics will only perform a full crawl test once every week. but even the crawl test also not helping any thing out for me.
-
Everyone, thanks for helping... Greatly appreciated.
-
Hi there Hanzo,
Thanks for reaching out! it looks like you are having some trouble with the crawl test. Keri is correct that our crawl test uses "Cached" information to construct your crawl, which can take up to 2 days to clear. While I am not sure why the sites are still reporting 404s, there's a few things that could explain why you might be getting a stale crawl:
- Your server simply did not update the changes you've made on the backend.
- There might an issue with our crawler, which in my last status there isn't a outage that I know of.
I looked into your crawl data and the 404s seems to be confirmed by the report, if you download your latest report and do a sort you should see that
Hope I was able to provide some insight, please let me know if you have questions!
Best,
-
I believe the crawl test has a cache of a couple of days. I'm asking someone from the help desk to come in and confirm, but it may be Monday before they have a chance to do so.
-
I know there is third party app which I can use to crawl,
but then isn't the crawl test is there for us to do testing instead of using other app rather than seomoz's tool?
-
You may want to give screaming frog or xenu's link sleuth. They should be able to crawl you site and give you the info you need.
-
From what I do with the crawl test, it doesn't show me the latest crawl. I need to check whether all the error 404 or related error was being solved. It only show me the old data which was crawl before but not the latest one.
-
Hanzo, what is it that you need to do that the crawl test isn't helping you with?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz Pro crawl signaling missing canonical which are not?
Hi,
Moz Pro | | rolandvintners
I'm trying MozPro considering using it.
One of the tool which is appealing is the crawl and insights.
After quick use, I really question many of the alerts, for instance, I got a "missing canonical tag" on this url: https://vintners.co/wine/grawu_gto#2020 but when I check my markup, there's clearly a canonical tag: <link rel="canonical" href="https://vintners.co/wine/grawu_gto"> Anybody can explain?
I asked Moz Pro staff when being onboarded but didn't get an answer...
Honestly, I'm questioning the value of these crawls, or may be I miss something?0 -
Using Keyword Tool Results
I love the keyword tool for giving me direction and helping to prioritize. My question: Once I have the prioritized keywords, do you recommend having a page for each of the top keywords, using the keyword as the page name? Or is it better to sprinkle the keywords into existing pages? Thank you.
Moz Pro | | bhsiao0 -
Lag time between MOZ crawl and report notification?
I did a lot of work to one of my sites last week and eagerly awaited this week's MOZ report to confirm that I had achieved what I was trying to do, but alas I still see the same errors and warnings in the latest report. This was supposedly generated five days AFTER I made the changes, so why are they not apparent in the new report? I am mainly referring to missing metadata, long page titles, duplicate content and duplicate title errors (due to crawl and URL issues). Why would the new crawl not have picked up that these have been corrected? Does it rely on some other crawl having updated (e.g. Google or Bing)?
Moz Pro | | Gavin.Atkinson0 -
Migration tool from RavenTools
I like to migrate some web sites from RavenTools. Do you have any migration tool utility to do it?
Moz Pro | | awebdesign
what do you recommend agencies migrating from RavenTools to seomoz?
Thanks
Lewis0 -
What's the best tool to use to compare competirors
A client of ours has asked us to compare their search rankings to competitors. What's the best tool to use in SEOMoz to do this?
Moz Pro | | BillyBobGriffin0 -
What SEO Tools Do You Use?
Things changed a bit for me when Raven Stopped using google and SemRush data and I haven't exactly found a solution I'm happy with so Just wanted to use what people use alongside SEOMoz, or what they use instead of certain parts of SEOMoz. Before I was using Raven Tools, Screaming Frog SEO Crawler but currently I'm using Screaming Frog SEO Crawler, SEOMoz (trial), and SerpIQ (trial).
Moz Pro | | GBabyWilson0 -
Recommended Custom Reporting Tool?
Can anyone recommend a reporting system I can use to send reports to my clients based on their campaigns in SEOMOZ This appears to be a missing link in the program - Or as a newbie I just have not found it yet. Thanks in advance!
Moz Pro | | HGbiz0 -
Where is the keyword difficulty tool data sourced from?
I also use Market Samurai, and I've noticed what seem to be big discrepancies with the keyword data presented by this (data comes from Majestic SEO) and the Keyword Difficulty Tool. To take just one example, I analyze the term "how to remove tea stains" In the Keyword Difficulty Tool, this returns the following: Root Domain Linking Root Domains: 2,233 Page Linking Root Domains: 4 When I use Market Samurai, however, the data returned is: RDD (Domains linking to this domain): 19,911 RDP (Domains linking to this page): 19 I thought that these two metrics were the same for both tools, but I've written them out in case someone sees a difference. As I say, Market Samurai data is sourced from Majestic SEO - a reputable SEO company - but I have no idea where the Keyword Difficulty Tool data is from, nor why these differences are so pronounced? Are they indeed the same metrics in both cases, or am I missing something? Any insight would be much appreciated.
Moz Pro | | ZakGottlieb710