Only 11 pages being crawled
-
Hi,
Can some one have a look and see why out of 400+ pages we only have 11 being crawled on here??
http://www.lifetimelegal.co.uk
Kind Regards
Elissa
-
When I search your site in Google it shows me 82 results against my query “site:domain.com” so it seems like Google is slowly crawling your site but you are right the rate of crawling pages is quite slow and to increase this here are few things that you should follow
- Strong Internal Linking
It is important to have a strong internal linking between the pages if you want Google and other search engine to crawl your page. Please check if you have a strong and powerful internal linking between the pages
- Xml Sitemap
The other thing that is missing on your site is xml sitemap. The idea is to add an xml sitemap and add it in Google webmaster tool and this will indicate Google to crawl different areas of your website with no hassle
Hope this will help!
-
Just looking around your site, the code seems ok - to a large extent.
But you are missing a sitemap (handy to point to all urls) and a robots.txt file
Also just clicking around i don't see 400 pages? is there a subdomain or folder you aren't linking to from the main site?
-
Hi Elisa,
It looks like it's pretty simple, when I crawl your Web site with Screaming Frog I only found 11 pages too. The reason is that the other pages aren't linked from the 11 pages found during a crawl. I would recommend to link to your other pages as well so these pages are found.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How does Google treat significant content changes to web pages and how should I flag them as such?
I have several pages (~30) that I have plans to overhaul. The URLs will be identical and the theme of the content will be the same (still talking about the same widgets, using the same language) but I will be adding a lot more useful information for users, specifically including things that I think will help with my fairly high bounce rate on these pages. I believe the changes will be significant enough for Google to notice, I was wondering if it goes "this is basically a new page now, I will treat it as such and rank accordingly" or does it go "well this content was rubbish last time I checked so it is probably still not great". My second question is, is there a way I can get Google to specifically crawl a page it already knows about with fresh eyes? I know in the Search Console I can ask Google to index new pages, and I've experimented with if I can ask it to crawl a page I know Google knows (it allows me to) but I couldn't see any evidence of it doing anything with that index. Some background The reason I'm doing this is because I noticed when these pages first ranked, they did very well (almost all first / second page for the terms I wanted). After about two weeks I've noticed them sliding down. It doesn't look like the competition is getting any better so my running theory is they ranked well to begin with because they are well linked internally and the content is good/relevant and one of the main things negatively impacting me (that google couldn't know at the time) is bounce rate.
Search Behavior | | tosbourn0 -
Location Pages
Hi. A client of mine offers multiple services and covers a region of the UK. They want to target each major town/city within this area. However, there are 20 cities and services offered range from 5-15 services. I am in the process of creating a location page for each city, so it can be optimised separately however I am not sure if there is a better way to do it? Or should I create a page for each city & service. So I for example I end up with 10 London pages with each one offering a different service? These can all be optimised for different services within London then? Any suggestions? Thanks
Search Behavior | | YNWA0 -
Decent Bounce Rate but extremely low visit duration and page depth?
I'm having a bit of difficulty understanding the Bounce Rate, Visit Duration, and Page Depth metrics in Google Analytics. GA is reporting that my site's bounce rate is pretty decent - currently 36%. Yet when I drill down into audience behavior engagement, I am seeing that the vast majority of visit durations are 0-10 seconds, and the page depth is only 1 for a majority of visitors. If this were the case, wouldn't my bounce rate be higher?
Search Behavior | | JPS890 -
Page ranking in .com but not in .co.uk
Hi there, I tried to search the Q&A but couldn't find any answers to my issue. We have a page that is ranking #2 for the term "translation memory" in google.com, but it doesn't show in Google.co.uk. This has been like this for weeks now. We are not targeting any specific country in GWT. Does anyone know a possible explanation for this? Thank you.
Search Behavior | | SDLOnlineChannel0 -
How come some local 7 pack listings link to site and some link to the G+ page?
Does anyone know how to fix this issue? Even though a site profile has had the website added to it Google continues to link the main "title tag" link to the G+ page and not the actual website domain. Thanks for any info in advance! https://www.google.com/#sclient=psy-ab&q=dog+sitting+in+rockaway&oq=dog+sitting+in+rockaway&gs_l=hp.3..0i22i30l4.14871.16189.1.16397.8.8.0.0.0.0.296.2042.2-7.7.0...0.0...1c.1.15.psy-ab.Y1db0jo77V0&pbx=1&bav=on.2,or.r_cp.r_qf.&bvm=bv.47244034,d.bmk&fp=722b460c2153b7be&biw=1920&bih=910
Search Behavior | | irvingw0 -
Is putting/removing Adsense ads on the site affects crawling for seo?
Because I noticed when we totally remove Adsense ads on our site, the pages crawled per day on the google webmastertools suddenly dropped into noticable amount and we tested again to turn it on for a singe day, it jumped up again. So if Adsense affects crawling then, if we have adsense ad on all pages of the site the more chances it gets crawled by the bot? WS76R8w
Search Behavior | | CruiseControl0 -
Google Is Displaying An Alt image tag as my homepage's page title
Google is randomly displaying the alt image tag as the page title for my homepage. It happens when you search for the brand name, but the page title appears as "BrandName Logo" (obviously not "BrandName"). Has anybody seen this happen before?
Search Behavior | | MichaelWeisbaum0 -
How to get more page impressions?
I'm wondering about one of our web-projects. There's a lot of good interesting content but the statistics of page impressions don't make me very happy. Each user is visiting just 1,5 sites per visit. That's really not much. We have other (similar) projects where this problem does not exist, where user are visiting a lot more sites per visit. I have no idea what could be the reason for it. Do you know / use some tricks to get more page impressions? Thank you, Sally
Search Behavior | | SallyO0