Why would only 1 pg of an 18 pg site be crawled?
-
I signed up yesterday. Added 4 sites. The one I really need data on now has only had 1 page crawled. The other sites have had almost all pages crawled (over 40 each) in one day.
What is wrong?
The main domain has a 301 redirect to another domain name is that the problem?
Is there something wrong at Google analytics? I dont manage this site and I'm picking up behind another firm..where should I start my discovery?
Thanks so much!
-
Here are some common reasons why only one page may be crawled in your SEOmoz campaign. Let us know if one of these isn't the cause and we'll dig deeper!
-
What's the URL? or URLs of the main domain redirected and the domain you are expecting to get indexed?
-
I will check the nofollow, but I'm feeling like it is the 301 redirect from one top-level domain to another. The target domain has NO link juice at all and it has been live for about 6 months. Its possible the redirect site has not been seen by Moz, but its been on the web for the exact same time as the referrer domain.
-
One day is not a long time but look at the code on the site if you suspect something is wrong.Check out your meta robots tag and make sure you're not noindexing or nofollowing. Check your robots.txt file to make sure you're not blocking.
Or you can run this http://www.xml-sitemaps.com/ sitemap generator and see if the are crawling your pages or bailing on the first page. If they are crawling your site Google most likely is unless you are specifically disallowing Googlebot which I doubt.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Crawl Diagnostics - Historical Summary
As we've been fixing errors on our website, the crawl diagnostic graphs have been showing great results (top left to bottom right for errors). The problem is the graphs themselves aren't very pretty. I can't use them in my internal reports (all internal reports are standardised colours/formats). Is there anyway of exporting the top level summary with historic data so the graphs can be recreated in company colours? I don't want the detailed CSV breakdown of what errors occurred, but rather than on X date there were Y errors, the next month Z errors and so forth. The data must already be in the SEOMoz system in order to create the graphs themselves - I was hoping this can be made available to us if it isn't already? Does anyone know if there is already a way of doing this? I've tried to 'inspect element' and find the underlying data in the source code but to no avail, and can't see any exports that would do this. Thanks in advance Dean
Moz Pro | | FashionLux0 -
Crawl Diagnostics
Hello, I would appreciate your help on the following issue. During Crawl procedure of e-maximos.com (WP installation) I get a lot of errors of the below mentioned categories: Title Missing or Empty & Missing Meta Description Tag for the URLs: http://e-maximos.com/?like_it=xxxx (i.e. xxxx=1033) Any idea of the reason and possible solution. Thank you in advance George
Moz Pro | | gpapatheodorou0 -
Using Seomoz for Site Evaluation am I up to par ?
Just wanted to see how people using the seomoz bar would rate a four month old site with Domain-Homepage Authority of 27 Mozrank of 5.08 and Moztrust of 5.65 . I've read up on all the factors but just wanted to know if Im up to par on building a great site thats search engine friendly. Inner pagers are on a PA of 20 and around the same mozrank and moztrust levels of +- 5.
Moz Pro | | NikolasNikolaou0 -
Why does Crawl Diagnostics report this as duplicate content?
Hi guys, we've been addressing a duplicate content problem on our site over the past few weeks. Lately, we've implemented rel canonical tags in various parts of our ecommerce store, over time, and observing the effects by both tracking changes in SEOMoz and Websmater tools. Although our duplicate content errors are definitely decreasing, I can't help but wonder why some URLs are still being flagged with duplicate content by our SEOmoz crawler. Here's an example, taken directly from our Crawl Diagnostics Report: URL with 4 Duplicate Content errors:
Moz Pro | | yacpro13
/safety-lights.html Duplicate content URLs:
/safety-lights.html ?cat=78&price=-100
/safety-lights.html?cat=78&dir=desc&order=position /safety-lights.html?cat=78 /safety-lights.html?manufacturer=514 What I don't understand, is all of the URLS with URL parameters have a rel canonical tag pointing to the 'real' URL
/safety-lights.html So why is SEOMoz crawler still flagging this as duplicate content?0 -
Crawl Errors from URL Parameter
Hello, I am having this issue within SEOmoz's Crawl Diagnosis report. There are a lot of crawl errors happening with pages associated with /login. I will see site.com/login?r=http://.... and have several duplicate content issues associated with those urls. Seeing this, I checked WMT to see if the Google crawler was showing this error as well. It wasn't. So what I ended doing was going to the robots.txt and disallowing rogerbot. It looks like this: User-agent: rogerbot Disallow:/login However, SEOmoz has crawled again and it still picking up on those URLs. Any ideas on how to fix? Thanks!
Moz Pro | | WrightIMC0 -
Open Site Explorer Says I have 1,627 inbound links, but only downloads 275\. Am I missing something?
Is there a feature i'm missing out on here? I want to download the complete link profile, but I only see 275 of 1,627 links when I export to CSV. Any guidance would be appreciated!
Moz Pro | | lipoweb0 -
How Would You Plan Long Term SEO (1 year and more)?
Hi, I'm new to SEO and learning fast. Myself joined together with my friends have set up a string of websites each for different products to sell online. To start with we have finalized keywords, optimized the on-page using the on-page analysis tool and right now about to start working on link building. For the first month we have planned to do around 20 bookmarking, 3 articles each to 15 article directories, 30 directory submissions (priority to niche based), business page listing in hot frog etc, 3 articles each submitted to 10 web 2.0 properties, 1 press release to 15 pres release sites, some Q&A links and few blog comments, 10 video submission and 1 guest blogging. We have also completed setting up facebook fan page and twitter account and active in them too. For anchor text diversity we will be using keywords only in links from article submission and web 2.0. For links from other methods, the anchor text will be either website name or website url. And we will be targeting 4 keywords per website (2 keywords for home page and 2 for 2 sub-pages). The difficulty level of the keywords range from 40% to 60%. Now, I have few questions which I believe the experts over here can help. 1. For the first month we have planned the above link building, but hpw build links from different websites in coming month? 2. For web 2.0 properties we can keep adding articles to the same blog we have created or we need to create separate set of web 2.0 properties for each month. 3. Are we missing any link building methods or strategy? If so, can you please tell me the method? I know some of the questions might be silly, but being a beginner it would be a great help to know the answer for these questions from this community. Thanks, Sridhar
Moz Pro | | chosenindian0 -
Amount of Pages Crawled Dropped Significantly
I am just wondering if something changed with the SEOMoz crawler. I was always getting 10,000 or near 10,000 pages crawled. After the last two crawls I am ending up around 2500 pages. Has anything changed that I would need to look at it see if I am blocking the crawler or something else?
Moz Pro | | jeffmace0