No (seomoz) crawler report since 7th may !!
-
Hi Mozteam,
I added a site less than 200 pages in the tool "seomoz crawler", at May 7.
We are May 15 and the tool always displays "crawl in progress."
Do you have a problem about this tool?
This is embarrassing ...
Thank you for your reply.
David
France
-
Hi Joel
if I tell you that I am doing SEO for 13 years you will not believe me :-))
tiredness or inattention ...thank you Joel and other contributors for your answers, I appreciate it.
David
-
Hey David,
Thanks for reaching out. I looked at your account and don't see any crawls that started on the 7th. I do see a crawl that started on the 3rd and hasn't completed because you are blocking all user agents in your robots.txt file.
You have this directive listed:
User-agent: *
Crawl-delay: 10
Disallow: /That is going to prevent all bots from accessing your site, not just RogerBot.
You'll want to either remove that or add a directive before that for User-agent: RogerBot allowing full access. Once that's done, just wait for the crawl to refresh and it should complete just fine.
Thanks!
Joel. -
Thank you,
no result at all... since may 7..
meanwhile I used Integrity .. but it is unfortunate that the report crawler does not work.
-
you have no results at all? as perfect007 said its updated once a week, so it normally says "in progress"
But if you still get no results by tomorrow, then report to the seomoz staff, along time ago I had a crawl problem where it was only crawling about 500 pages of my site, when we had 10,000+ pages. There was a technical problem with the crawl with my site which they fixed very quickly
-
Hi
thank you but it is precisely this tool I'm talking about ...
the crawl is "in progress" since May 7 ..
David
-
SEOMoz Tool crawls a website once a week, but you can do a separate crawl of any site (up to 3000 URLs) at http://pro.seomoz.org/tools/crawl-test. They generally update crawl Thursday to Thursday along with Ranking.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
MOZ Crawler
Hi, how much time it will take MOZ crawler to take entire site? In 24 hours it crawled only 500 pages isn't it too slow? My website has almost 50k pages.
Moz Pro | | macpalace0 -
What value am I getting from SEOmoz?
Okay, I've been using the trial version of SEOmoz for almost a week, but, I'm just not sure what to do with it to be honest. I'm not an SEO expert, so, a lot of the terminology and reports are confusing. So far the only thing I've found useful are the domain and page duplication errors, but, I can get the same info from Google Webmaster Tools. Am I missing something? We have a very simple site for a small business, not sure I can justify $99 per month for a service I don't really understand. Is this service more for SEO professionals than business owners? -Tom
Moz Pro | | TomHu0 -
Why does SEOMoz think I have duplicate content?
The SEOmoz crawl report shows me a large amount of duplicate content sites. Our site is built on a CMS that creates the link we want it to be but also automatically creates it's own longer version of the link (e.g. http://www.federalnational.com/About/tabid/82/Default.aspx and http://www.federalnational.com/about.aspx). We set the site up so that there are automatic redirects for our site. Google Webmaster does not see these pages as duplicate pages. Why does SEOmoz consider them duplicate content? Is there a way to weed this out so that the crawl report becomes more meaningful? Thanks!
Moz Pro | | jsillay0 -
Adjusting SEOmoz Crawling Speed
How do you adjust the SEOmoz crawling speed? SEOmoz tried to crawl 10,000 pages in 3 hours and crashed our MySQL server.
Moz Pro | | cappuccino891 -
OSE Link Report Question.
Hi, when i export a link report as a csv file via the export tool on OSE, there is a column in the exported table called "Numder of Link". Please explain me, what does this column says exactly. Its located between "Domain Authorithy" and "Number of Domains Linking to Domain". Thanx, Seb.
Moz Pro | | TheHecksler0 -
How do you use SEOmoz
I'm a newbie here. I've got a week left on my free trail. I really like SEOmoz, I might even love it a bit. 🙂 I'm trying to justify the cost. I usually don't spend money on my Internet Marketing. I've done it through finally buying some tools to help me get there. Massive change in the last year. I'm a long ways from getting rich YET though. 🙂 I've gone from $30 a month to $1000 a month in a year. So I think I'm on my way now. I'm trying to figure out why I should continue my subscription and actually start paying for it. If I were a developer I can certainly see why but the cost would so go way up. 🙂 I'm in the lowest level package with only five websites. I have 10 I'm working on. I know that's probably five to many at one time. I'm having a little trouble justifying the cost at this time. At my income level $100 a month is significant. I can see the value of seeing where my competition has backlinks. Sometimes my competition is Cnet. haha Well, I can beat them on a specific page at times. Hmm, can I search the URL list for links? Perhaps i can if I export it. That didn't occur to me. Now that could be of use if I can find my keywords. If their link is on Amazon though, I'm going to have trouble getting a link there. 🙂 Maybe I should work on less competitive links but I made good money last month with one page that was beating them. WAS beating them. How do you use SEOmoz? How do you justify the cost, that is offset the expense. If its not making me money i don't see the value. I can get a lot of this information for free but it sure is easier to get it here. Which saves me time. And the other tool i use isn't that good and not always reliable and slow. I've got a week left on my free trail. I had decided to let it go but now I'm reconsidering. $100 is a lot for me and I need to spend more on SEO outsourcing. I wonder if I wouldn't be better off dropping it for a while and then coming back. This certainly isn't mean to be a critical post at all. I'm looking for reasons to stay and make better use of it. Thanks for the thoughts, Rusty
Moz Pro | | RustyF0 -
Getting SEOMoz reports to ignore certain parameters
I want the SEOMoz reports to ignore duplicate content caused by link-specific parameters being added to URLs (same page reachable from different pages, having marker parameters regarding source page added to the URLs). I can get Google and Bing webmaster tools to ignore parameters I specify. I need to get SEOMoz tools to do it also!
Moz Pro | | SEO-Enlighten0 -
Help with SEOmoz API
Hi guys, I'm trying to make API requests from my webserver via PHP. I'd like to retrieve data from the SEOmoz URL Metrics API. Unfortunately I always get the error response "unauthorized" even when I copy and paste the Sample Valid API Signature generated by your system into the browser. Is Signed Authentication not longer supported? I even tried the sample PHP Code SignedAuth.php but there's the same problem, too. If signed authentication is not longer available, do you have a code example for the basic http authorization? Thanks, Brandon
Moz Pro | | thegreatpursuit1