Moz crawls
-
Hi all! I'm running two separate campaign crawls at the moment that I'm having a few issues with. The first is http://www.muchbetteradventures.com/.
I'm tracking this at root to try an pick any problems with a previous version of the site, which is on the v1.muchbetteradventures subdomain. However, I'm only seeing 100 or so pages as being crawled in Moz, compared to thousands in Google. There's no access blocked alerts in Moz either.
The second is http://www.sothebys.com/. I started this crawl at root a few days ago and no pages at all have been processed. Very odd!
Any advice would be much appreciated.
-
Thanks Reuben! Just getting my head around Screaming Frog! Can it be used to flag up duplicate content issues like Moz?
-
Hello and great question! If you are ever missing pages from your crawl, you can always email help@moz.com with the name of the campaign and a couple examples of missing pages. We can usually diagnose this issue pretty quickly. In a lot of cases, this could be due to the way some domains are forwarded or redirected. I encourage you to email us the issue with a few examples so that the Help Team, including myself, can dig in and figure out whats going on. Sorry for the delay, I hope we can help get to the bottom of your crawl issues.
-
1. Google's index may or may not be reflective of the pages you actually have on your site—likely the latter, hence the difference between the pages on your site and the pages in Google's index. Right now, the v1 subdomain times out, so no crawlers will be able to do anything with it. The www domain only has about 250 or so URLs.
2. Sotheby's website blocks all but a few crawlers, which is why Moz would not crawl any pages. http://www.sothebys.com/robots.txt
I would suggest using your own crawling software to untangle these issues. If you aren't familiar with Screaming Frog, you should check it out.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Solved MOZ Points
What happened to the MOZ points system and rewards for participating?
Product Support | | WebMarkets1 -
Refund From MOZ for Cancelled Account-How To Get Refund, Phone Number for MOZ Corporate Office?
I have written MOZ several times requesting account cancellation procedures but they don't seem interested in responding. I pre-paid my account in October 2019, paying for one year until October 2020. I would like to cancel my account and get a refund of the pro-rated unused amount. After not getting a response, I searched for a corporate phone number for MOZ. No phone number can be found. I am somewhat concerned as legitimate companies have phone numbers. Can someone advise me as to how to get my refund? Also, I subscribe to MOZ local. I need to know of canceling MOZ pro will inadvertently cancel MOZ local. Thanks,
Product Support | | Kingalan1
Alan0 -
Can you export campaigns from one Moz Pro account to another?
Looking to export our active campaigns from our account to another. Is this possible?
Product Support | | Mediademon0 -
Moz Analytics Reports Scheduling
Hi, We have been using Moz now for a few weeks now and we are trying to run reports based on various time frames and can't seem to do so? For example on the if we needed a report from say 17/04/2014- 30/04/2014 how would we achieve this? Or if we wanted to schedule reports based on a calendar month- how do we achieve this? I tried running reports on the 1/05/2014 and received reports for Apr 25 - May 2, 2014. Also on the DASHBAORD- the timeframe only appears to display 'WEEKLY' and the last week of the month- 23th April- 30- Apr. Or will this change once we have more historical data compiled? Thanks,
Product Support | | Faxem0 -
Dude Phishing on Moz
Hey guys - just so you know I got this today from a ghost on Moz. Hello,
Product Support | | Chenzo
I like your profile in this moz.com community network and I think you are a nice person. Can we get in contact? I'm sorry if i am embarrassing you, I got curious to know you better after viewing your profile i think that i have something important to exchanged with you i shall explain more about myself including my pictures, please E-mail me to not in this site because i am a new in this community and i don't visit this site often, I'd like to get to know you if you don't mind
Please i will Tell you more about my self
thanks & regardsFigured I would share and keep you up to date.Your pal,Chenzo1 -
Latest Crawl Stats Not Showing
I got the email that Moz crawled my site for the week of February 8. I expected to log in and find some shinny new data, but new stats are not showing in my dashboard yet. Is there a delay? Is there something wrong?
Product Support | | ChadC0 -
When will MOZ allow you to pull data by a specific date range?
I can only pull by week at the moment. When will it be possible to pull custom date ranges?
Product Support | | webbmason2 -
Can you create additional users for Moz Analytics?
I have just begun setting up Moz Analytics for some of my clients. It lets me add 5 client's sites to a single account but I can't find anywhere to create an additional user/login for a specific account that way I can give access to each client only to their campaign. Is this not possible and if not something you plan on integrating in the near future?
Product Support | | Carlson3