Crawl Errors and Notices drop to zero
-
Hi all,
After setting up a campaign in Moz the crawl is successful and it showed the Errors and Warnings in crawl diagnostics (each one had about 40-50), but after a few days the number dropped to zero. Only the "notices" seems to stay normal, with a slight drop since the campaign set up, but not dropping to zero. I set this campaign up in a colleague's account and the same thing happened shortly after set up. I didn't find any Q&A already posted so any insight is appreciated!
-
Glad I could help!
-
Thank you for looking into this. Really appreciate it!
-
Hey Vanessa,
Every URL that is in the report you forwarded is on the blog, so it definitely looks like the noindex tag on the blog is the reason for the drop in crawl errors and warnings. If you prefer that we begin crawling the blog again, you can have that tag removed, but the tag also means that the search engines aren't indexing those pages or finding those errors any longer either.
Let me know if you have any other questions.
Chiaryn
-
Thanks for looking into this, Chiaryn. That is the correct campaign. I have a report from April 17 and I sent it to help@seomoz.org. If you can shed any light on this that would be a big help. I appreciate it!
-
Hey Vanessa,
Thanks for writing in.
I looked into your account and I think you are referring to the Sparky campaign. Unfortunately, I can only see the most recent crawl data, so I don't have a way to compare the crawls from prior to April 24th to see why the number of errors and warnings would have dropped off around that time.
I do see that we picked up a noindex, nofollow tag on the blog pages on April 16th, so it may be that we were crawling other pages on the blog that had errors and warnings before the tag was added. But once the noindex, nofollow tags were added, we weren't able to crawl those pages and report back on the errors.
If you can think of any other changes that may have taken place around April or if you have an old report that shows some of the URLs that were reported as having errors, I can look into this further for you. If you prefer not to include the error report on this public forum, you can always email it to help@seomoz.org and include my name in the subject line.
I hope this helps.
Chiaryn
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Blog archive pages in Craw Error Report
Hi there, I'm new to MOZ Pro and have a question. My scan shows Archive pages as having crawl issues, but this is because Yoast is set up to block robots on these pages. Should I be allowing search engines to crawl these pages, or am I fine to leave them as I have it set up already? Any advice is greatly appreciated.
Moz Pro | | mhenshall
Marc0 -
Why has my MozTrust & DA dropped
Hi The company i work for are in the middle of relaunching our product, so during this time we have not been generating much traffic to the site. We are still getting about 800 SEO visits a month, however, as we aren't doing email marketing our site traffic overall has dropped. I have noticed that since October or MozTrust and Domain Authority seems to be dropping. Our DA was at 18 then in the space of a few weeks has dropped to 10. Our Moztrust was at about 3 and now is at 0. Our links to the site seems to be disappearing to according to Moz, however other back linking website are saying they are still there. Could someone maybe shed some light on what i may have done wrong to lose these two things and so quickly. This all happened mid to late October. During the Hummingbird release we were fine! We have also just updated out website with lots of new content. In fact increased it 4x. There are great internal links throughout the site. Thank you
Moz Pro | | Smartloan0 -
What is the best approach to handling 404 errors?
Hello All - I'm a new here and working on the SEO on my site www.shoottokyo.com. When I am finding 4xx (Client Errors) what is the best way to deal with them? I am finding an error like this for example: http://shoottokyo.com/2010/11/28/technology-and-karma/ This may have been caused when I updated my permalinks from shoottokyo.com/2011/09/postname to shoottokyo.com/postname. I was using the plug in Permalinks moved permanently to fix them. Sometimes I am able to find http://shoottokyo.com/a-very-long-week/www.newscafe.jp and I can tell that I simply have a bad link to News Cafe and I can go to the post and correct it but in the case of the first one I can't find out where the crawler even found the problem. I'm using Wordpress. Is it best to just use a plugin like 'Redirection' to move the rest that have errors where I cannot find the source of the issue? Thanks Dave
Moz Pro | | ShootTokyo0 -
Crawl test from tools
Hi, I notice that the crawl test which is from the Research Tools doesn't really get a new crawl even though there is 2 crawl per day. It will only provide the data which was acquire from the crawl diagnostics in my pro account. There is no point for me to get the data which I get from my crawl diagnostic isn't it? Even seomoz provided with more than 2 crawl per day also useless in this case. This whole thing doesn't make sense as the crawl diagnostics will only perform a full crawl test once every week. but even the crawl test also not helping any thing out for me.
Moz Pro | | hanzoz0 -
Third crawl of my sites back to 250 pages
Hi all, I've been waiting some days for the third crawl of my sites, but SEOMOZ only crawled 277 pages. The next phrase appeared on my crawl report: Pages Crawled: 277 | Limit: 250 My last 2 crawls were of about 10K limit. Any idea? Kind regards, Simon.
Moz Pro | | Aureka0 -
Settings to crawl entire site
Not sure what happened but I started a third campaign yesterday and only 1 pages was crawled, The other two campaigns has 472 and 10K respectively. What is the proper setting to choose in the beginning of campaign setup to have the entire site crawled. Not sure what I did different and I must be reading the instructions incorrectly. Thanks, Don
Moz Pro | | NicheGuy210 -
Why have my rankings dropped on my keyword report but there is no change for the same keywords on google??
I received a keyword ranking report over the weekend, was horrified to see some of my keywords have dropped ranks by 20+ for some 😮 I checked them on google and they haven't moved (confused.com) Any information would be greatly appreciated.
Moz Pro | | Anthonykal-group0 -
Error 403
I'm getting this message "We were unable to grade that page. We received a response code of 403. URL content not parseable" when using the On-Page Report Card. Does anyone know how to go about fixing this? I feel like I've tried everything.
Moz Pro | | Sean_McDonnell0