MOZ Crawler only crawling one page per campaign
-
We set up some new campaigns, and now for the last two weekly crawls, the crawler is only accessing one page per campaign. Any ideas why this is happening? PS - two weeks back we did "upgrade" the account. Could this have been an issue?
-
Thanks for the suggestions. There was not a robots.txt file. I'm hoping that will do it.
-
Also check out this help desk article on reasons why the crawler gets stuck at one page on a campaign. http://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-only-crawled-one-page
-
This happened to me in the past. My client's site had a custom 404 that redirect all missing pages to the homepage. When roger bot (seomoz crawler) searched for the robots.txt page (that was non-existent) it continually got redirect to the homepage.
So on that note, check if you have a robots.txt file. If not, add one and see if it solves the problem.
-
can we see urls, there may be a techniocal reason
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz Pro crawl signaling missing canonical which are not?
Hi,
Moz Pro | | rolandvintners
I'm trying MozPro considering using it.
One of the tool which is appealing is the crawl and insights.
After quick use, I really question many of the alerts, for instance, I got a "missing canonical tag" on this url: https://vintners.co/wine/grawu_gto#2020 but when I check my markup, there's clearly a canonical tag: <link rel="canonical" href="https://vintners.co/wine/grawu_gto"> Anybody can explain?
I asked Moz Pro staff when being onboarded but didn't get an answer...
Honestly, I'm questioning the value of these crawls, or may be I miss something?0 -
Ahrefs vs Moz
Hi! I noticed the Moz DA en the Ahrefs DA are very different. Where https://www.123opzeggen.nl/ has a DA of 10 at MOZ, the DA at Ahrefs is 26. Where does this big difference come from? Do you measure in different ways? I hope you can answer this question for me. Thank you in advance!
Moz Pro | | NaomiAdivare2 -
Pages with Temporary Redirects on pages that don't exist!
Hi There Another obvious question to some I hope. I ran my first report using the Moz crawler and I have a bunch of pages with temporary redirects as a medium level issue showing up. Trouble is the pages don't exist so they are being redirected to my custom 404 page. So for example I have a URL in the report being called up from lord only knows where!: www.domain.com/pdf/home.aspx This doesn't exist, I have only 1 home.aspx page and it's in the root directory! but it is giving a temp redirect to my 404 page as I would expect but that then leads to a MOZ error as outlined. So basically you could randomize any url up and it would give this error so I am trying to work out how I deal with it before Google starts to notice or before a competitor starts to throw all kinds at my site generating these errors. Any steering on this would be much appreciated!
Moz Pro | | Raptor-crew0 -
Moz scores
Hi All, Could anyone please explain for me why the moz scores that show under SERPs in Google search show one set of values, but when i click on the SERP listing and go to that page, the Moz scores at the bottom of the tab the page is open in are completely different. I.E - SERP result Wireless Alarms <cite>www.wireless-alarms.net/</cite>Honeywell, Friedland, Response, Wireless house home intruder burglar alarms and wirefree doorbells chimes and accessories.<iframe class="SEOmoz-iframe" src="chrome-extension://eakacpaijcpapndcfffdgphdiccmpknp/html/serpbar.html#{" settings":{"dmr":false,"dmt":false,"mr":true,"mt":true,"serp-overlay":true,"toolbar-enabled":true,"subdomain-metrics":false,"serp-panel-open":true,"toolbar-position":"bottom"},"lsdata":{"feid":3,"fipl":3,"fmrp":2.0446037910058426,"fmrr":5.396862303226778e-12,"ftrp":1.8723654310590483,"ftrr":9.21604483751679e-12,"fuid":3,"pda":8.903939958502189,"peid":3,"pid":3,"pmrp":1.6026230610187469,"pmrr":1.3566326316606153e-10,"ptrp":1.025503845909542,"ptrr":1.4972548621304158e-11,"puid":3,"ueid":2,"uemrp":2.577887966559377,"uemrr":5.40110633420739e-13,"uid":2,"uipl":2,"ujid":2,"umrp":2.577887966559377,"umrr":5.40110633420739e-13,"upa":23.634692786039714,"utrp":4.9331532541404854,"utrr":1.9684091945588755e-16},"user":{"level":"pro","options":{},"proenabled":true,"aclurl":"http:="" moz.com="" users="" level?src="mozbar","loginURL":"https://moz.com/login","logoutURL":"https://moz.com/logout","apiRequest":"url-metrics","cols":"133146078688","expired":false,"accessId":"pro-RGFkZHlTbXVyZg%3D%3D","expires":1374925378,"signature":"tBSBXpLbBmk073ofsfBwnilmODw%3D","displayName":"DaddySmurf"},"serp":4,"host":"www.wireless-alarms.net"}"" scrolling="no"></iframe> Page result <label>Page:</label><label id="Page Authority" class="key lsdata">PA:</label> <label id="SEOmoz-data-PA" class="val lsdata">27</label><label id="mozrank" class="key lsdata" title="MozRank">mR:</label> <label id="SEOmoz-data-mR" class="val lsdata">5.30</label><label id="moztrust" class="key pro-only lsdata" title="MozTrust">mT:</label> <label id="SEOmoz-data-mT" class="val pro-only lsdata">5.61</label><label id="SEOmoz-data-uid">1,950</label> links from
Moz Pro | | DaddySmurf
<label id="SEOmoz-data-uipl">2</label> Root Domains<label>Root Domain:</label><label id="dom-pageauthority" class="key lsdata" title="Domain Authority">DA:</label> <label id="SEOmoz-data-DA" class="val lsdata">24</label><label id="SEOmoz-data-puid">100,262</label> links from
<label id="SEOmoz-data-pid">3</label> Domains<label>Subdomain:</label><label id="SEOmoz-data-fuid">19,953</label> links from
<label id="SEOmoz-data-fipl">3</label> DomainsThank you.Si0 -
My Campaign only crawled 3 pages on my site
On my first crawl of a new campaign, the software only crawled 3 pages. XXXaceXXXscholarships.org any ideas?
Moz Pro | | Santaur0 -
Crawl Diagnostics 403 on home page...
In the crawl diagnostics it says oursite.com/ has a 403. doesn't say what's causing it but mentions no robots.txt. There is a robots.txt and I see no problems. How can I find out more information about this error?
Moz Pro | | martJ0 -
Why is my crawl STILL in progress?
I'm a bit new here, but we've had a few crawls done already. They are always finished by Wednesday night. Our website is not large (by any means), but the crawl still says it's in progress now 3 days later. What's the deal here?!?
Moz Pro | | Kibin0 -
When should I start a new campaign ?
I already have one campaign running with several keywords and competitors tracking, I was wondering when should I start a new one ? is this option is for those who have multiple websites ? we only have one !.
Moz Pro | | processia0