Why would only 1 pg of an 18 pg site be crawled?
-
I signed up yesterday. Added 4 sites. The one I really need data on now has only had 1 page crawled. The other sites have had almost all pages crawled (over 40 each) in one day.
What is wrong?
The main domain has a 301 redirect to another domain name is that the problem?
Is there something wrong at Google analytics? I dont manage this site and I'm picking up behind another firm..where should I start my discovery?
Thanks so much!
-
Here are some common reasons why only one page may be crawled in your SEOmoz campaign. Let us know if one of these isn't the cause and we'll dig deeper!
-
What's the URL? or URLs of the main domain redirected and the domain you are expecting to get indexed?
-
I will check the nofollow, but I'm feeling like it is the 301 redirect from one top-level domain to another. The target domain has NO link juice at all and it has been live for about 6 months. Its possible the redirect site has not been seen by Moz, but its been on the web for the exact same time as the referrer domain.
-
One day is not a long time but look at the code on the site if you suspect something is wrong.Check out your meta robots tag and make sure you're not noindexing or nofollowing. Check your robots.txt file to make sure you're not blocking.
Or you can run this http://www.xml-sitemaps.com/ sitemap generator and see if the are crawling your pages or bailing on the first page. If they are crawling your site Google most likely is unless you are specifically disallowing Googlebot which I doubt.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Crawl Diagnostics - Historical Summary
As we've been fixing errors on our website, the crawl diagnostic graphs have been showing great results (top left to bottom right for errors). The problem is the graphs themselves aren't very pretty. I can't use them in my internal reports (all internal reports are standardised colours/formats). Is there anyway of exporting the top level summary with historic data so the graphs can be recreated in company colours? I don't want the detailed CSV breakdown of what errors occurred, but rather than on X date there were Y errors, the next month Z errors and so forth. The data must already be in the SEOMoz system in order to create the graphs themselves - I was hoping this can be made available to us if it isn't already? Does anyone know if there is already a way of doing this? I've tried to 'inspect element' and find the underlying data in the source code but to no avail, and can't see any exports that would do this. Thanks in advance Dean
Moz Pro | | FashionLux0 -
Comparing with Open Site Explorer
Hi, I am trying to compare a website that has a url of e.g. https://mysite.com on Open Site Explorer. Any idea how to do this? It will only compare it when I use www and it also doesn't accept https. So I am comparing www.mysite.com which has redirects on it https://mysite.com but I am worried it's not comparing the right stats? If this makes sense and you can help it would be greatly appreciated. Cheers
Moz Pro | | Hughescov0 -
Pages Crawled: 0 ?
I've been with SEO Moz for over a month and a half. Why would this weeks crawl have Pages Crawled: 0? I've made no changes since the crawl last week that had 10k pages crawled...
Moz Pro | | mr_w1 -
Getting your site totally indexed by SEOMOZ
Hi guys! Ijust started using SEOMOZ software and wondered how it could be that my site has over 10.000 pages but in the Pro Dashboard it only indexed about 1500 of them. I've been waiting a few weeks now but the number has been stable ever since. Is there a way to get the whole site indexed by SEOMoz software? Thanks for your answers!
Moz Pro | | ssiebn70 -
Status Errors generated from xml site map
I just ran a crawl test on our site and I'm seeing a lot of 404 errors that are referredt from the xml sitemap.. Anyone know how to fix it?
Moz Pro | | IITWebTeam0 -
404 errors in SEOMoz crawl tool
I currently have several 404 errors in the latest crawls from SEOMoz. Here is an example of the error. http://dealerplatform.com/blog/2011/10/23/videos-for-auto-dealers/www.dealerplatform.com/ In all cases the error is a result of www.dealerplatform.com being added to the real url. Anyone seen this before? The site is a wordpress mutlisite. I don't see where this incorrect link is showing up anywhere on the website. Any advice would be helpful. Thanks
Moz Pro | | Chris_Gregory0 -
Tool which shows site ranking for a given keyword
Hi all. I have a client with a specific request and wanted to ask if there is a reliable tool which allows a user to enter a given site and keyword, and it will return the site's ranking for that keyword. More specifically: Needs to work for Google, Yahoo and Bing Needs to work for various countries such as Google.ca, Google.it, etc. Needs to show at least the top ?10k rankings, not just the top 50 The last requirement is the challenge. I clearly recognize anything past the top 50 or so ranks is really off the map, but the client would like to view his current standings.
Moz Pro | | RyanKent0 -
Crawl complete, but nothing changed?
Hi everyone, According to my account, the crawl diagnostics were completed yesterday. However, the duplicate page titles that it mentions aren't correct. The changes that I implemented several days ago are not being shown in the report. When I click the duplicate page title links, the latest date in the graph is 3/26. However, it says the crawl was completed on 3/30. Does it take a few days for the reports to match what the crawl actually discovered?
Moz Pro | | beeneeb0