Site crawler hasn't crawled my site in 6 days!
-
On 4.23 i requested a site crawl. My site only has about 550 pages. So how can we get faster crawls?
-
Crawl In Progress
Subdomain
www.taxproblem.org
Submitted 5:47pm GMT
Apr 23rd 2011
Is it a good idea to delete this (can't see how in the tool). I was thinking that maybe it got lost or something, it's now 10 days. I wanted to make another request.
I was mistaken before, the site wasn't crawled, it was just a campaign update.
-
I listed my craws in progress with the dates, so yes.
-
That one uses the exact same technology without the pretty report. Have you used it lately? It was upgraded a week ago and I believe intended to replace the one in seomoz labs.
-
Actually that's the link to the worst one that doesn't do anything. Yesterday my site was crawled, so it actually did take a week, but as you can see the results here are lagging...
Crawl In Progress
Subdomain
www.tax-audit.us
Submitted 1:36am GMT
Apr 25th 2011
Crawl In Progress
Subdomain
www.taxproblem.org
Submitted 5:47pm GMT
Apr 23rd 2011
-
That seems long to me. If you run a crawl. You can run it here instead and get results in 24 hours. Up to 2 per day and 3000 pages. It won't give you that nice red, blue and yellow report but it basic info is the same. You just need to manually analyze it. http://pro.seomoz.org/tools/crawl-test
-
I'm not sure to be honest but before it slowed down a little I tended to get a crawl once a week per site, whether a site was large or small.
-
Thanks. When fixed, how long should we have to wait for crawls?
-
That's not actually that long, and there's a queue anyway... I had a small site wait a couple of weeks recently but it did get crawled, was just in the queue for a while first. Just give it a while longer and it'll be fine.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Site property is verified for new version of search console, but same property is unverified in the old version
Hi all! This is a weird one that I've never encountered before. So basically, an admin granted me search console access as an "owner" to the site in search console, and everything worked fine. I inspected some URL's with the new tool and had access to everything. Then, when I realized I had to remove certain pages from the index it directed me to the old search console, as there's no tool for that yet in the new version. However, the old version doesn't even list the site under the "property" dropdown as either verified or unverified, and if I try to add it it makes me undergo the verification process, which fails (I also have analytics and GTM access, so verification shouldn't fail). Has anyone experienced something similar or have any ideas for a fix? Thanks so much for any help!
Reporting & Analytics | | TukTown1 -
Getting google impressions for a site not in the index...
Hi all Wondering if i could pick the brains of those wise than myself... my client has an https website with tons of pages indexed and all ranking well, however somehow they managed to also set their server up so that non https versions of the pages were getting indexed and thus we had the same page indexed twice in the engine but on slightly different urls (it uses a cms so all the internal links are relative too). The non https is mainly used as a dev testing environment. Upon seeing this we did a google remove request in WMT, and added noindex in the robots and that saw the index pages drop over night. See image 1. However, the site still appears to getting return for a couple of 100 searches a day! The main site gets about 25,000 impressions so it's way down but i'm puzzled as to how a site which has been blocked can appear for that many searches and if we are still liable for duplicate content issues. Any thoughts are most welcome. Sorry, I am unable to share the site name i'm afraid. Client is very strict on this. Thanks, Carl image1.png
Reporting & Analytics | | carl_daedricdigital0 -
Site operator result anomaly
"Site:" search for site:http://www.mycity4kids.com/Bangalore/activity-based-approach is showing 76 results.I am using SERPS Redux to collect all the indexed pages, but when I re-checked indexed status of these pages using "site operator" google showed that these pages are not indexed. What is the possible explanation for this? Thanks
Reporting & Analytics | | prsntsnh0 -
One big site for a loose theme or multiple sites for each specific theme?
Hi, Our company produces content related to one loose overall theme. Within that we write content and sell products on three specific sub-themes. Some of our customers cross over and have an interest in two or all three themes and others are only interested in one. At present we have one site covering reviews of products relating to all three sub-themes... ....and three other sites offering how-to guides and tutorials dedicated to each sub-theme. We do not have a lot of time to commit to SEO and so we are considering merging the content we have on all three subjects into the one site covering them all. Each of these sub-themes could have websites in their own right and my worry is that it will be harder to rank for these subject specific terms if the content is not on a site dedicated to that subject. But of course if they were all together then any links we build will be consolidated into one big site. Does anyone have any experience of this or have any advice on what the best thing to do would be? Thanks for your help!
Reporting & Analytics | | frantan0 -
Setting up Goals in Analytics when no common 'order confirmation' type page
Hi I'm working on a project/client and have asked them for the common url that shows whenever user finishes the purchase process so i cant set it up as a Goal in GA so we can track conversions etc Since site is dynamically generated it does not have such a page. Dev are suggesting setting up a new goal, generate a URL and script and they will append to a similar call. Does this make sense/sound like it would work ? And is it quite easy to do that in Analytics ? Normally i just add a URL as a goal and jobs done, don't know about scripts etc ! Cheers Dan set up a new Goal and generate a URL and script and send that to us and we'll append this to a similar call we already did for this at your request originally
Reporting & Analytics | | Dan-Lawrence0 -
How effective is OSE in crawling press release links?
How effective is OSE in crawling press release links? We have released a few press releases recently (over the last couple of months) and OSE doesn't seem to have found them.
Reporting & Analytics | | deuce1s1 -
Should we add the city to our keywords for a site that is only local?
This is one of those things I have done for a long time and all of a sudden asked myself was it necessary: For our local clients, we add the city name (Houston, KC, Birmingham) after each keyword. An example would be TestSite.com/big-tester-houston A Title Tag might be Big Tester Houston | Test Site, etc. Where appropriate we do the same with H1 or H2's and occasionally in the content we will use the city name. The thought being that since the site is only for a given city, it will be deemed more relevant than a site from outside.( I understand there are other factors in SEO; this is a specific question around adding the city). Yes, we also optimize with local directories/citation sites. Is this overkill, is it even worthwhile? Is there any evidence one way or another? I would love some strong opinions backed up with something other than anecdotal evidence where possible.
Reporting & Analytics | | RobertFisher0