Moz crawls
-
Hi all! I'm running two separate campaign crawls at the moment that I'm having a few issues with. The first is http://www.muchbetteradventures.com/.
I'm tracking this at root to try an pick any problems with a previous version of the site, which is on the v1.muchbetteradventures subdomain. However, I'm only seeing 100 or so pages as being crawled in Moz, compared to thousands in Google. There's no access blocked alerts in Moz either.
The second is http://www.sothebys.com/. I started this crawl at root a few days ago and no pages at all have been processed. Very odd!
Any advice would be much appreciated.
-
Thanks Reuben! Just getting my head around Screaming Frog! Can it be used to flag up duplicate content issues like Moz?
-
Hello and great question! If you are ever missing pages from your crawl, you can always email help@moz.com with the name of the campaign and a couple examples of missing pages. We can usually diagnose this issue pretty quickly. In a lot of cases, this could be due to the way some domains are forwarded or redirected. I encourage you to email us the issue with a few examples so that the Help Team, including myself, can dig in and figure out whats going on. Sorry for the delay, I hope we can help get to the bottom of your crawl issues.
-
1. Google's index may or may not be reflective of the pages you actually have on your site—likely the latter, hence the difference between the pages on your site and the pages in Google's index. Right now, the v1 subdomain times out, so no crawlers will be able to do anything with it. The www domain only has about 250 or so URLs.
2. Sotheby's website blocks all but a few crawlers, which is why Moz would not crawl any pages. http://www.sothebys.com/robots.txt
I would suggest using your own crawling software to untangle these issues. If you aren't familiar with Screaming Frog, you should check it out.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved How can I create a custom gift box using MOZ's products, and what are some creative ideas for designing the packaging?
Creating a custom gift box using MOZ's products can be a fun and thoughtful way to personalize a gift. Here's a step-by-step guide on how to do it, along with some creative packaging ideas: Step 1: Select the Products
Product Support | | MeltonMark8888
Browse MOZ's product catalog and select the items you want to include in the gift box. Consider the recipient's preferences, interests, and the occasion for which you're creating the gift box. Step 2: Choose the Box
Select a Galaxy Gift Box that will fit the products comfortably. It can be a plain cardboard box or a decorative one, depending on the overall aesthetic you're aiming for. Make sure the box is sturdy enough to protect the contents. Step 3: Gather Materials
Besides the products, gather materials for packaging, such as tissue paper, bubble wrap, or shredded paper for cushioning. You'll also need ribbon, twine, or other decorative elements for the finishing touches. Step 4: Arrange the Products
Arrange the chosen products inside the anniversary gifts for men . Place larger items at the back and smaller items at the front for visibility. Ensure that the arrangement looks aesthetically pleasing and well-balanced. Step 5: Add Filler
Add your chosen filler material to protect the products during shipping and to enhance the presentation. You can use colored tissue paper, shredded paper, or bubble wrap.
Gift Box Max0 -
Is there still a way to put in a support ticket with Moz. I cannot find it on the site.
I sent an email a few minutes ago to support@moz.com but don't know if that is a usable address or not. I would prefer an answer from a Moz staffer. Thanks,
Product Support | | RobertFisher0 -
How to refund moz pro subscription?
I want to refund the subscription purchase process and return the money back
Product Support | | ResearchTrainingAcademy0 -
I am unable to access my campaigns. Is anyone else having trouble connecting to http://analytics.moz.com/?
I am unable to access my campaigns. Is anyone else having trouble connecting to http://analytics.moz.com/?
Product Support | | jleite0 -
Moz pricing plans don't make sense
Hey. I posted a question about this on my other Moz account (one I use for moz local), but it appears to have been removed, so here goes again. Can someone from Moz please explain to me why that in your plans, as the price goes up and more campaigns are allowed, the amount of keywords tracked per campaign goes down? $149 plan - 5 campaigns - 450 keywords = 90 keywords per campaign. $249 plan - 25 campaigns - 1100 keywords = 44 keywords per campaign $599 plan - 100 campaigns - 3700 keywords = 37 keywords per campaign What confuses me here with your pricing plans is two fold Modern SEO requires a lot of quality content, interlinked together to rank well (in most cases). Your SEO guides even talk about this. Blogging is one of the most popular ways to do this. However, in any modest website these days, especially one that runs a blog, how does tracking only 37 keywords per campaign make sense? The fact is, that even your starter plan with only 90 per campaign doesn't make sense. My business website is tracking about 300 (that actually drive traffic). I provide my SEO clients with the same type of work I would do for my self, which again reinforces that 37 keywords is plainly pathetic. Every online pricing model I've ever seen follows one simple rule: When price goes up, you get more for your money, not less. At first glance you might think that is what you're getting when you step up a plan and get more campaigns, but then to have less keywords per campaign simply doesn't make sense at all. What does make sense is to have a more flexible pricing model. Instead of locking us into set tiers which don't really make sense, you should allow a more flexible pricing BEFORE we have to go up to enterprise. Why not have a per project price of 'x' price per month, then have a price per keyword or maybe per 100 keywords. This would allow all of us the flexibility to run campaign depths that make sense for us, not for your counterintuitive views of how we should be tracking them. Again, I'd really like a Moz staff person to respond to this as the last time I commented about this, it was removed.
Product Support | | Multiverse-Media-Group0 -
SEO Moz PRO app Isn't Crawling Anymore
Hi, We find the SEO Moz PRO app a great tool for us. What is the reason that it is not re-crawling the websites included in our campaigns anymore?
Product Support | | solution.advisor0 -
Why has my Google Analytics dropped completely from the results on this weeks crawl?
The Account code hasn't changed in either Moz or on site? Also I added 53 new keywords to my campaign and they haven't all been ranked, it's like Moz has done half a job?! S.O.S.
Product Support | | danwebman0 -
Latest Moz reports (pro) not including competitive link analysis
Hi Pls advise when these have been regenerated once fixed or will they just be emailed out automatically ? My clients all after their New Year monthly & quarterly reports hence this info is needed urgently, pls advise ? Also when will reports start showing social data in the reports and also when will the data that currently shows on the dash start to be accurate ? (or are you leaving this 'as is' on pro since your migrating to Moz analytics ?) Many Thanks Dan
Product Support | | Dan-Lawrence0