Why Is SEOMOZ No Longer crawling All Of My Site
-
Hi all,
I joined Seomoz over a month ago and Roger has been crawling all of the pages on the site approx 20 pages. Through out the last few weeks I have been working on the errors and notices identified by Roger. However, this week Roger has only re-crawled 1 page and is not picking up all the other pages.
Has any one come across this problem. can you recommend any thing to resolve it?
Many thanks in advance....
-
Hi Greg,
I haven't heard of that one before..hate to sound like a broken record, but best to email the help desk for this one too. Thanks!
-
I am not sure If I have the same problem... I previously had 46 pages crawled and added a couple in the last week. So the last crawl should have said 48. Oddly though, it reads N/A.
I would think a little tooltip should explain what N/A means there. Does anyone know?
-
Hi Echolls, so sorry to hear that. Can you send an email to help at seomoz dot org and let our help desk know? Thanks!
Keri
-
Just chiming in to add that I have the same problem going right now. Worked totally fine for a few days with 200+ pages crawled, now just down to one.
-
The re-crawl today has now picked up all the pages on the site. The problem was only for a few days.... Many thanks
Danny
-
There's a known bug at the moment that we're investigating that has some crawls suddenly dropping down to only a page or two. I believe both of you have sent your information to the help desk, and they'll help you from there. I'm making this comment so anyone else searching the forums in the next couple of days can see this answer as well and just contact the help desk directly.
-
Hi Seb,
Yeah, sent it through now waiting for a reply. Let me know if you have any joy and if it's an error on their behalf?
Many thanks
Danny
-
I did come across that answer but none of them really applies to me. Have sent a help request. Many thanks for your help.
Danny
-
Hi,
I am having the same Problem: Crawled Pages droped from 10k to 1 Pages... send a request for help to help@ allready...
Seb.
-
Here are some common reasons why only one page of your site may be crawled http://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-only-crawled-one-page. For more specific help, sending an email to the help team at help@seomoz.org is the best way to get your particular issue looked at.
Thanks!
Keri
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEOmoz Not Picking Up Links
I'm finding that SEOmoz often doesn't pick up on many of the links my client's websites are attaining. The links do appear in search engine and often have a high domain authority (often PR links, which I why I follow up to see if they've been picked up). I do tend to see many of the links appear in webmaster tools, so it's a little frustrating that they don't appear, even after months of pages being live. Thoughts?
Moz Pro | | SebastianDyer0 -
Still Cant Crawl My Site
I've removed all blocks but two from our htaccess. They are for amazonaws.com to block amazon from crawling us. I did a fetch as google in our WM tools on our robots txt with success. SEOMoz crawler here hit's our site and gets a 403. I've looks in our blocked request logs and amazon is the only one in there. What is going on here?
Moz Pro | | martJ0 -
Why does SEOMoz only crawl 1 page of my site?
My site is: www.thetravelingdutchman.com. It has quite a few pages, but for some reason SEOMoz only crawls one. Please advise. Thanks, Jasper
Moz Pro | | Japking0 -
Only few pages (308 pages of 1000 something pages) have been crawled and diagnosed in 4 days, how many days till the entire website is crawled complete?
Setup campaign about 4-5 days ago and yesterday rogerbot said 308 pages were crawled and the diagnostics were provided. This website has over 1000+ pages and would like to know how long it would take for roger to crawl the entire website and provide diagnostics. Thanks!
Moz Pro | | TejaswiNaidu0 -
Slowing down SEOmoz Crawl Rate
Is there a way to slow down SEOmoz crawl rate? My site is pretty huge and I'm getting 10k pages crawled every week, which is great. However I sometimes get multiple page requests in one second which slows down my site a bit. If this feature exists I couldn't find it, if it doesn't, it's a great idea to have, in a similar way to how Googlebot do it. Thanks.
Moz Pro | | corwin0 -
Tools that crawl 2 million page sites
Our site is about 2million pages deep, 50% of which is stale content. Yes, I know - OMG #unhygienic. Even if we get approval to get rid of half of it. SEOMoz Pro Elite only crawls 20k deep - what can i do to crawl and diagnose the whole site. Are there any tools anyone can suggest. SEOMoz??
Moz Pro | | ilhaam0 -
Campaign Crawl Report
Hello, Just a quicky, is there anyway I can do a crawl report for something in a campaign so I can compare the changes? I know you can do a separate crawl test, but it wont show the differences,and the next crawl date isnt untill the 28th.
Moz Pro | | Prestige-SEO0 -
How do you use SEOmoz
I'm a newbie here. I've got a week left on my free trail. I really like SEOmoz, I might even love it a bit. 🙂 I'm trying to justify the cost. I usually don't spend money on my Internet Marketing. I've done it through finally buying some tools to help me get there. Massive change in the last year. I'm a long ways from getting rich YET though. 🙂 I've gone from $30 a month to $1000 a month in a year. So I think I'm on my way now. I'm trying to figure out why I should continue my subscription and actually start paying for it. If I were a developer I can certainly see why but the cost would so go way up. 🙂 I'm in the lowest level package with only five websites. I have 10 I'm working on. I know that's probably five to many at one time. I'm having a little trouble justifying the cost at this time. At my income level $100 a month is significant. I can see the value of seeing where my competition has backlinks. Sometimes my competition is Cnet. haha Well, I can beat them on a specific page at times. Hmm, can I search the URL list for links? Perhaps i can if I export it. That didn't occur to me. Now that could be of use if I can find my keywords. If their link is on Amazon though, I'm going to have trouble getting a link there. 🙂 Maybe I should work on less competitive links but I made good money last month with one page that was beating them. WAS beating them. How do you use SEOmoz? How do you justify the cost, that is offset the expense. If its not making me money i don't see the value. I can get a lot of this information for free but it sure is easier to get it here. Which saves me time. And the other tool i use isn't that good and not always reliable and slow. I've got a week left on my free trail. I had decided to let it go but now I'm reconsidering. $100 is a lot for me and I need to spend more on SEO outsourcing. I wonder if I wouldn't be better off dropping it for a while and then coming back. This certainly isn't mean to be a critical post at all. I'm looking for reasons to stay and make better use of it. Thanks for the thoughts, Rusty
Moz Pro | | RustyF0