MOZ Crawl help
-
Our MOZ report says it crawled 1800 pages so it reports a lot of errors based on those pages. We don't have that many pages on our site. What is MOZ crawling? I updated the profile to make sure it crawls the filtered page section of Google Analytics.
-
Hey Jessica,
I took a look at your crawl diagnostics and there isn't anything that looks too out of the ordinary. You have 415 duplicate pages, which is over inflating your page count.
Additionally, when I exported your crawl diagnostics CSV I saw a mixture of static URLs and Dynamic URLs. This may mean that you have two coppies of each page being crawled, which could be leading to over inflated page totals. You might want to look at your CMS and make sure that it is not making 2 copies of each page.
Cheers,
Ryan Watson
Business Development Associate | Moz -
Hi Jessica,
Well that's a pretty good mix
Having a bunch of different kinds of errors like that could be due to a combination of issues, but I would think that first of all you have a duplicate content issue either because your cms is creating it through different urls for things like multiple categories, archive pages and that kind of thing or because you have a server setup issue that is allowing access to the same pages through multiple urls (like www vs non www urls). It might well be a combination of these things accounting for different errors so you are going to need to narrow down the data to find out exactly what is going on.
Download your error report in csv, open it in excel and select all and then do ctrl-windows-L combination. This will put your data into a filterable table. You can then go to the headers and filter (for example) only 404 pages or only duplicate title pages. Once you have filtered for a specific error have a look at the left hand column for which page or pages the problem is appearing on and then the far right hand column to see which page is linking to this page or pages. You will then have a better idea where the problem is and how it is being reached by the crawler and that will guide you on where to look to fix it. If you want to give a couple of example urls a few obvious things might stand out.
Hope that helps!
-
By filtered, I meant that we have a profile that filters out employees hitting the site. Sorry, shouldn't have mentioned it because it isn't relevant.
-
Hi Lynn,
Thank you for getting back to me. Here is an image of our diagnostics with the errors.
-
Hi Jessica,
What are the errors telling you? If it is a lot of duplicate content type errors it could be an indication that your site is linking to the same pages in multiple ways. So even though you think your site has xx number of pages, to the crawler (and search engines) it actually has more! Not sure what you mean in regards updating the profile to crawl filtered section of google analytics? If you care to give us an example of the errors and your site we might be able to give more details.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does Moz use Stripe as it Credit Card Processor
Hi , What Credit Card Processors does Moz use? Do they use Stripe.com ?
Product Support | | stuartcanvas0 -
How to block Rogerbot From Crawling UTM URLs
I am trying to block roger from crawling some UTM urls we have created, but having no luck. My robots.txt file looks like: User-agent: rogerbot Disallow: /?utm_source* This does not seem to be working. Any ideas?
Product Support | | Firestarter-SEO0 -
Analytic goals in Moz
We should have the ability to see any and all conversions goals, as defined in analytics, in Moz. After all, the whole point of marketing, SEO, PPC, Social, etc. is to drive sales or leads that create sales right? So, why should we have a dashboard tool that doesn't show us the 1 thing that ultimately matters the most? I understand that Moz simply wasn't designed to do this, but I think that should change. After all, we are in this to make money I hope. My 2 Cents. Micha
Product Support | | Multiverse-Media-Group1 -
How do you delete a campaign in Moz Analytics ? (i set up 2 campaigns for the same project by accident)
Hi How do you delete a campaign in Moz Analytics ? (i set up 2 campaigns for the same project by accident) cheers dan
Product Support | | Dan-Lawrence1 -
I'm tired of logging in to MOZ
I like this site, I really do, which is why I visit multiple times a day. But I grow weary of these premium sites that require me to log in multiple times a day. This morning I was simultaneously working at ordercup.com, strengthcoach.com, and moz.com, and all three log me out at every turn. Argh!!! What's worse is that some MOZ pages think I'm logged in and others don't. I don't fully understand the logic behind the curtain, so I wander from page to page trying to get the login in sync. Why can't these sites work like lynda.com where I can stay logged in for days and weeks? To top it off, LastPass rolled out a new release that broke auto-login. All this logging in is getting in the way of me getting anything done.
Product Support | | ChristopherGlaeser3 -
Why are my moz points messed up?
These are probably stupid questions, but they've been bothering me. On my profile page it says complete your profile - earn 10 more moz points! However, I completed my profile and it says it is 100% complete with 0 items left to complete. Is there any reason these points aren't registering? Also, on the header it says my username and that I have 52 moz points, but on my profile page it says I only have 46. Is there a wait time for one of these to update or sync? Also, is there a way to track how many moz points you have gotten in a particular month? I know there are limits to how many points you can get in a given period.
Product Support | | redfishking1 -
Duplicate Page Content Report on Moz - Still ranking in Google Results?
Hi, I am experiencing 2 issues with the Duplicate Page Content in Moz. Every week it is notifying me of new duplicate content - so it seems to be missing duplicate content each week and the crawl is never above the 5000-6000 page mark, which means that it is under 10K which is the limit, so presumably everything is crawled in that one go so surely it should detect all of the dupe content on 1 crawl as opposed to having to do various crawls to detect it no? The dupe content report shows me pages that indeed have duplicate content but after checking, these are ranking on Google for their terms... ? Is the duplicate page content report incremental ? Will it add more duplicate content and increase the report every week or does it just show that week's results? If so, it's a bit like chasing my tail... Help!
Product Support | | bjs20100 -
Moz login token, time to live...
Suspect it's just a wrinkle as a result of the change from seomoz to moz, but on seomoz the remember me checkbox had a time to live of a few weeks, possibly a month, which was excellent. Since the great rebranding and migration (which is excellent by the way), time to live from ticking remember me is in the order of a couple of hours, which is pretty annoying. Any chance the web folks could bump it up a little, better yet put it back to 30 days? 🙂
Product Support | | WorldText4