MOZ Crawler only crawling one page per campaign
-
We set up some new campaigns, and now for the last two weekly crawls, the crawler is only accessing one page per campaign. Any ideas why this is happening? PS - two weeks back we did "upgrade" the account. Could this have been an issue?
-
Thanks for the suggestions. There was not a robots.txt file. I'm hoping that will do it.
-
Also check out this help desk article on reasons why the crawler gets stuck at one page on a campaign. http://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-only-crawled-one-page
-
This happened to me in the past. My client's site had a custom 404 that redirect all missing pages to the homepage. When roger bot (seomoz crawler) searched for the robots.txt page (that was non-existent) it continually got redirect to the homepage.
So on that note, check if you have a robots.txt file. If not, add one and see if it solves the problem.
-
can we see urls, there may be a techniocal reason
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Lag time between MOZ crawl and report notification?
I did a lot of work to one of my sites last week and eagerly awaited this week's MOZ report to confirm that I had achieved what I was trying to do, but alas I still see the same errors and warnings in the latest report. This was supposedly generated five days AFTER I made the changes, so why are they not apparent in the new report? I am mainly referring to missing metadata, long page titles, duplicate content and duplicate title errors (due to crawl and URL issues). Why would the new crawl not have picked up that these have been corrected? Does it rely on some other crawl having updated (e.g. Google or Bing)?
Moz Pro | | Gavin.Atkinson0 -
How To Ques. Getting ranked on page one for a keyword when you compete with bigger websites/companies/stores
Can David Beat Goliath. I work with small businesses with top products that are up against big brands and their online presence. If I am working with them to create content that meets the needs of all their stakeholders/customers/prospects to generate revenue I wonder if keyword targeting with content can really pay off to get them page one, #1 position ranking. So I ask you this question? How do you create a story for a small online store that can get ranked on page one for a keyword when you compete with bigger websites (or sites with higher domain authority)? I don't need all the basics, I'm just looking for a key insight or tip that you have found or heard is working for a David to beat a Goliath (and hold their position rank once they get highly ranked). We are up against sites - for viable keywords -who have higher domain authority and in some cases more content or link backs. Also, I've notice in situations when I do get to page one and I'm in position 7 MOZ analytics show low to no traffic coming from it? Yikes, what do I do to improve that? These are top keywords.
Moz Pro | | brandawakening0 -
Https subdomain campaign
Hi! How can I setup a campaign for a subdomain similar to this? https://sub.domain.com Is it possible to use https protocol? Thanks a lot! Jesus
Moz Pro | | adesis0 -
What is the best way to set up my seomoz campaign with multiple landing pages
I have 30 geo targeted landing pages under the same domain. So i want to track geo targeting keywords for each landing page. given this what is the best way to use seomoz and how do i set up and structure? example of landing page structure san francisco is - http://www.relationshipcounselingcenter.org nyc is - http://www.relationshipcounselingcenter.org/new-york-city-nyc-marriage-couples-therapy/ dc- http://www.relationshipcounselingcenter.org/washington-dc-marriage-couples-therapy/ etc Much thanks I'm a newbie to seomoz tools
Moz Pro | | sevin0 -
My account recently got deactivated due to billing issues. I reactivated my account, but all of my campaigns are gone. Is there a way I can get back my campaigns without having to redo all of them??
My account recently got deactivated due to billing issues. I reactivated my account, but all of my campaigns are gone. Is there a way I can get back my campaigns without having to redo all of them??
Moz Pro | | DorianDDR10 -
Crawl Diagnostics finding pages that dont exist. Will Rel Canon Help?
I have recently set up a campaign for www.completeoffice.co.uk. Im the in-house developer there. When the crawl diagnostics completed, i went to check the results, and to my surprise, it had well over 100 missing or empty title tags. I then clicked it to see what pages, and nearly all the pages it say have missing or empty title tags, DO NOT EXIST. This has really confused me and need help figuring out how to solve this. Can anyone help? Attached image is a screen shot of some of the links it showed me on crawl diagnostics, nearly all of these do not exist. Will the relation Canonical tag in the head section of the actual pages help? For example, The actual page that exist is: www.completeoffice.co.uk/Products.php Whereas, when crawled it actually showed www.completeoffice.co.uk/Products/Products.php Will have the rel can tag in the header of the real products.php solve this?
Moz Pro | | CompleteOffice0