Only 11 pages being crawled
-
Hi,
Can some one have a look and see why out of 400+ pages we only have 11 being crawled on here??
http://www.lifetimelegal.co.uk
Kind Regards
Elissa
-
When I search your site in Google it shows me 82 results against my query “site:domain.com” so it seems like Google is slowly crawling your site but you are right the rate of crawling pages is quite slow and to increase this here are few things that you should follow
- Strong Internal Linking
It is important to have a strong internal linking between the pages if you want Google and other search engine to crawl your page. Please check if you have a strong and powerful internal linking between the pages
- Xml Sitemap
The other thing that is missing on your site is xml sitemap. The idea is to add an xml sitemap and add it in Google webmaster tool and this will indicate Google to crawl different areas of your website with no hassle
Hope this will help!
-
Just looking around your site, the code seems ok - to a large extent.
But you are missing a sitemap (handy to point to all urls) and a robots.txt file
Also just clicking around i don't see 400 pages? is there a subdomain or folder you aren't linking to from the main site?
-
Hi Elisa,
It looks like it's pretty simple, when I crawl your Web site with Screaming Frog I only found 11 pages too. The reason is that the other pages aren't linked from the 11 pages found during a crawl. I would recommend to link to your other pages as well so these pages are found.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Decent Bounce Rate but extremely low visit duration and page depth?
I'm having a bit of difficulty understanding the Bounce Rate, Visit Duration, and Page Depth metrics in Google Analytics. GA is reporting that my site's bounce rate is pretty decent - currently 36%. Yet when I drill down into audience behavior engagement, I am seeing that the vast majority of visit durations are 0-10 seconds, and the page depth is only 1 for a majority of visitors. If this were the case, wouldn't my bounce rate be higher?
Search Behavior | | JPS890 -
Is it possible to know if visitor arrived at the web page via organic search and if so, show some content?
Hello, Is it possible to know if visitors are arriving at a web page via organic search? Background: We have a section of job description pages to explain typical tasks. These have very high bounce rate (some 100%), and I think people are confusing them with actual jobs. For example "stage designer". Many of those keyword we have very high rankings. I am thinking of having a small notice at the top of those page to say something like "if you are stage designer job, check out our job section". Thanks
Search Behavior | | CreativeChoices0 -
Irratic page rank results - why?
Hi, Hi- I've changed the title and reposted this question as I didn't get any insight. I really am going around in circles for this; so any help that can be given would be really appreciated.I know that you guys have the knowledge so really hoping you can share it! Thanks - background: I run two sites: www.ragsmetals.com and www.yourgoldfund.com: They offer similar products but to different markets: one is predominently trade, one predominently customer focused. They vie for the same keywords.e.g. Buy Gold My Issue: I have been trying to build www.yourgoldfund.com up from an SEO point of view; it is FALLING in the rankings; I am doing NOTHING with www.ragsmetals.com and it is rising in the rankings. I checked webmaster to see if there were any warnings as a result of penguin (found out how to do this on here - thanks for that!) there are none. I have optimized the pages a lot. I have put time into getting in bound traffic, and even more excitingly some experts (from reputable domains) have just linked to our site because they like our content! So to me things should be improving . NOTE: My OSE listed inbound links are incredibly diferent from google Webmaster. What can I do. I am a scientific person so I love the fact that I have 2 sites to compare...interested to hear your thoughts. Many thanks in advance
Search Behavior | | girlie0 -
Hi guys.. post-penguin my website coming in and out of serps every other day... what reason for that? ie. #11 --> #300+
We had one of the pre-penguin "unnatural links " messages in WMT - then Penguin hit April 24th/25th.. wee then set to work on Link profile... since 19th May we have had numerous search phrases come 'back' into rank pre-penguin for a day ie.. #5 - #10 and then drop the next.. ie 300+ this has been happening across a wide range of key phrases.... in fact it may well be that the key phrases are added to the serps 'briefly' or for a set amount of time... but our ranking checker checks daily so while it appears to be every other day in and out there may be another pattern... but the question is What is Google doing here and Why? any suggestions?
Search Behavior | | Geminineil1 -
Home page (s) deindexed
Ok odd one. 2 sites hosted on go daddy, neither sites has any cause for concern. But both sites have had there home pages deindexed or - 10000 penalty for no reason. We do the SEO for 1 site and not for the other. The server is shared with go daddy no idea on how many other 3rd party sites are on it. I've filed a reinclusion request for both sites. Any help is more than welcome.
Search Behavior | | therealmarkhall0 -
How to optimize a Stock Symbol page?
Hi, My website is for stock picking. The keywords in each stock page are stock symbol. Now the stock symbol rank of my website in google is around 30-50. I use On-Page Keyword Optimization tool on seomoz to optimize those page. Now all stock symbol pages are Grade A in on-page report card. Is there other suggestions to increase stock symbol page ranking? Thanks in advance! -Don
Search Behavior | | dodoflying0 -
How to get more page impressions?
I'm wondering about one of our web-projects. There's a lot of good interesting content but the statistics of page impressions don't make me very happy. Each user is visiting just 1,5 sites per visit. That's really not much. We have other (similar) projects where this problem does not exist, where user are visiting a lot more sites per visit. I have no idea what could be the reason for it. Do you know / use some tricks to get more page impressions? Thank you, Sally
Search Behavior | | SallyO0