Moz crawls
-
Hi all! I'm running two separate campaign crawls at the moment that I'm having a few issues with. The first is http://www.muchbetteradventures.com/.
I'm tracking this at root to try an pick any problems with a previous version of the site, which is on the v1.muchbetteradventures subdomain. However, I'm only seeing 100 or so pages as being crawled in Moz, compared to thousands in Google. There's no access blocked alerts in Moz either.
The second is http://www.sothebys.com/. I started this crawl at root a few days ago and no pages at all have been processed. Very odd!
Any advice would be much appreciated.
-
Thanks Reuben! Just getting my head around Screaming Frog! Can it be used to flag up duplicate content issues like Moz?
-
Hello and great question! If you are ever missing pages from your crawl, you can always email help@moz.com with the name of the campaign and a couple examples of missing pages. We can usually diagnose this issue pretty quickly. In a lot of cases, this could be due to the way some domains are forwarded or redirected. I encourage you to email us the issue with a few examples so that the Help Team, including myself, can dig in and figure out whats going on. Sorry for the delay, I hope we can help get to the bottom of your crawl issues.
-
1. Google's index may or may not be reflective of the pages you actually have on your site—likely the latter, hence the difference between the pages on your site and the pages in Google's index. Right now, the v1 subdomain times out, so no crawlers will be able to do anything with it. The www domain only has about 250 or so URLs.
2. Sotheby's website blocks all but a few crawlers, which is why Moz would not crawl any pages. http://www.sothebys.com/robots.txt
I would suggest using your own crawling software to untangle these issues. If you aren't familiar with Screaming Frog, you should check it out.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
No crawl data anymore
Using moz quite some time, but I don't have any crawl data anymore. What happened? (www.kbc.be)
Product Support | | KBC
http://analytics.moz.com/settings/campaign/517920.11285160 -
Moz free account
Hi, I currently have a Moz Pro account, if I was to downgrade to a free account am I still able to ask and answer questions on the Q&A area? Also, would I lose my points accrued?
Product Support | | KarlBantleman0 -
Is Google Analytics Connection with Moz broken?
Hi, I keep on getting this error on my moz campaigns "Our connection to your Google Analytics account was lost. Don't worry, you won't lose any data. Please reauthorize now." Everyday i click the reauthorize now and make sure everything is sync properly, but I keep on getting the same error everyday, is there something wrong with GA connection with Moz? I really need urgent help with this problem as I have more than 15 campaigns on moz and this tool is very important for my reporting. Thanks
Product Support | | Josh.B0 -
Moz Account - How to Select Monthly Timeframes
I have read that moz have now added the feature to select monthly timeframes when running reports. In my Account, I can only choose Weekly (the previous week) How do i go about selecting Monthly Timeframes? Thanks Adam
Product Support | | AMG1000 -
How to find first set of Moz rankings?
I'm trying to compare the state of our seo before we started moz to now. I can't find the first set of rankings and on-page grades when I initially setup Moz. I do have access to our first report, but in that first week, I made a number of changes based on the initial crawl/rankings/on-page grades. Anyone know how to get that? Thanks, Ruben
Product Support | | KempRugeLawGroup0 -
Several issues moz analytics
I have found several issues with Moz Analytics. Wondering if it is only me or am I missing something... 1. I am not able to create branded reports or reports what so ever. I need this functionality like it is advertised.
Product Support | | auke1810
2. In Search competition is not working at all. it states "not in top 50" for all keywords witch is not true.
3. In Crawl diagnostics I get this "Rel Canonical" issue even though the rel canonical tag is in the website. I have send a mail to support but no answer until today. Earlier I did receive a answer on my questions so i guess there is one way of sending questions to the moz team witch is not working.0 -
Why are my moz points messed up?
These are probably stupid questions, but they've been bothering me. On my profile page it says complete your profile - earn 10 more moz points! However, I completed my profile and it says it is 100% complete with 0 items left to complete. Is there any reason these points aren't registering? Also, on the header it says my username and that I have 52 moz points, but on my profile page it says I only have 46. Is there a wait time for one of these to update or sync? Also, is there a way to track how many moz points you have gotten in a particular month? I know there are limits to how many points you can get in a given period.
Product Support | | redfishking1