"New" issues not previously found being shown?
-
I'm not sure what logic Moz is using for its reporting of Site Crawl issues, but it appears to be pretty flawed (unless I'm missing something, which is possible).
I've got a client site that has been in Moz for about 6 months now. Every time the crawler runs, the same number of pages are reported as having been crawled. However I'm consistently getting "New Issues" reported that should have been reported during previous crawls.
Example: A redirect chain was reported several month ago. The referring URL was the homepage of the website, and we tracked it down to an old link in the header. This was fixed, marked as resolved, and the issue was not shown on the next crawl. Several weeks later, the same issue was reported for a different page on the website - a page which has existed since 2014 and was already crawled many times. Again, we fixed. Fast-forward to the report that just ran on 12/1 and we have the same issue reported, for a different page, which has also existed for years and has been previously crawled.
It's very hard to explain to a client "this item you are seeing has been resolved", only to have it continually crop back up in future reports. Note this is not limited to redirect chains - that's just an example. I'm seeing this for other items such as missing canonicals, duplicate titles, etc.
-
Well, you can't 100% rely on third-party tools anyways they might miss it sometimes especially Moz, they are still rookie in this. The other day, I got an email from Moz saying that we couldn't crawl one of your site "Warning" Red alert etc, Robots.txt isn't there. I doubled check it manually everything was smooth and then I made Moz re-crawl the site to check if everything is okay so yes it was.
Moz needs to work hard to improve their tool and it's function it doesn't give you the proff look and feel.
-
So the community is aware, I wrote into Moz for clarification on this and the response was:
Unfortunately it would not be possible to retroactively investigate why we were not previously picking up on these issues as I can only see your site as it is now.
So....either Moz software has a bug, or is not actually crawling sites in their entirety as they say they are. It's one or the other...
-
Thanks Meghan; I've sent an email in with 3 examples from 3 different campaigns.
-
Hi there!
Thanks so much for the great question! We'd be more than happy to look into this for you. Can you send an email on over to help@moz.com with the Campaign you're working with and some specific examples of the new issues you're seeing? That way we can dig into this and see what's going on.
Looking forward to hearing from you!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Data Analysis Tool - No data found for this domain
For some reason, about a week ago, my clients website nolonger appears on the moz analysis tool ( www.movietrailersarea.org ) which it previously was. now i get the error "Bummer! No data found for this domain" and now nearly all traffic has also depleted.
Moz Bar | | Mike569
site is still indexed by google & robots isnt blocking any crawlers.
any idea?3 -
Keyword Explorer - root domain (NEW): Domains outside US & Canada - no or no meaningful results
Basically I really like and would love to use the new root domain feature in the Keyword Explorer in my daily work. I usually deal with small to medium sized sites in Switzerland. Looking these up unfortunately it either gives me back nonsense (i.e. keywords that merely have nothing to do with the site; sites are very well keyword optimized) or no data ("There are no results for your search") at all. Is this going to change in the future (...honestly) or its simply due to the fact that MOZ focuses primarily on US & Canada and maybe huge sites in Europe? Thanks for your input. Cheers, Cesare
Moz Bar | | Cesare.Marchetti0 -
How do can the crawler not access my robots.txt file but have 0 crawler issues?
So I'm getting this errorOur crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster.https://www.evernote.com/l/ADOmJ5AG3A1OPZZ2wr_ETiU2dDrejywnZ8kHowever, Moz is saying I have 0 Crawler issues. Have I hit an edge case? What can I do to rectify this situation? I'm looking at my robots.txt file here: http://www.dateideas.net/robots.txt however, I don't see anything that woudl specifically get in the way.I'm trying to build a helpful resource from this domain, and getting zero organic traffic, and I have a sinking suspicion this might be the main culprit.I appreciate your help!Thanks! 🙂
Moz Bar | | will_l0 -
Need to solve "Oops our crawlers were unable to access" url for new campaign
I'm putting the url designfirstkitchenandbath.com and getting the "oops! our crawlers were unable to access the site. Since this site is a potential client, which shows up online, I can't get access to fix the code, plus while I can write a little html I don't feel comfortable working with hard, live code on someonelse's site. Anyone have a simple solution?
Moz Bar | | alisacromer0 -
Verified News Sources: A New Feature in Fresh Web Explorer Launched Today!
Hey gang - I wanted to mention a small update we've made to Fresh Web Explorer (I was the architect on this one). It enables you to filter your searches and/or your Alerts to show only those sources/domains we've observed in Google News. E.g. here's a search for GigaOm with news filtering on (180 results in the last 7 days) vs. the same search with news filtering off (1,811 results). It's mostly useful for folks who are getting overwhelmed by the quantity of mentions they see in FWE and Alerts (I was experiencing that myself with mentions for my name and Moz) and just want to filter to the most important/noteworthy stuff. It's not perfect - Google News does have some weird domains that show in there occasionally - but it's definitely a much better filter if you have a bigger brand or term/phrase you're watching. Any questions or feedback, please let us know!
Moz Bar | | randfish3 -
Can we access previous weeks/months key word analytic stats?
We're missing some data for our key word positioning from November and December of last year and I am looking to see if I can access this still? I realise i can access the previous weeks stats and also a month as a whole but is it possible to access previous weeks or months and how can i go about doing this? Thank you!
Moz Bar | | collection_260 -
Duplicate Page and Title Issues
On the last crawl, we received errors for duplicate page titles and some duplicate content pages. Here is the issue: We went through our page titles that were marked as duplicate and changed them to make sure their titles were different. However, we just received a new crawl this week and it is saying there are even more duplicate page title errors detected than before. We're wondering if this is a problem with just us or if it has been happening to other Moz users. As for the duplicate content pages, what is the best way to approach this and see what content is being looked at as a "duplicate" set?
Moz Bar | | Essential-Pest0 -
We Launched a new site and Rogerbot is still reporting on links/errors from the old site, is there a way to clear those out?
We are mostly a Branding agency, and have not put a lot of effort into SEO for ourselves... SEO tends to take a backseat to design most of the time, making it a little difficult for me at times when it comes to SEO. We recently launched a new site, http://Roninadv.com/ and the developer and I have done quite a bit of work to make it work well for Google. I was really looking forward to a new crawl report from Roger, but alas, It's like Roger crawled the old site? The new site has been up since last Monday. Is there a way to clear out the old errors? Do I just need to give roger more time?
Moz Bar | | PaulRonin0