Only 11 pages being crawled
-
Hi,
Can some one have a look and see why out of 400+ pages we only have 11 being crawled on here??
http://www.lifetimelegal.co.uk
Kind Regards
Elissa
-
When I search your site in Google it shows me 82 results against my query “site:domain.com” so it seems like Google is slowly crawling your site but you are right the rate of crawling pages is quite slow and to increase this here are few things that you should follow
- Strong Internal Linking
It is important to have a strong internal linking between the pages if you want Google and other search engine to crawl your page. Please check if you have a strong and powerful internal linking between the pages
- Xml Sitemap
The other thing that is missing on your site is xml sitemap. The idea is to add an xml sitemap and add it in Google webmaster tool and this will indicate Google to crawl different areas of your website with no hassle
Hope this will help!
-
Just looking around your site, the code seems ok - to a large extent.
But you are missing a sitemap (handy to point to all urls) and a robots.txt file
Also just clicking around i don't see 400 pages? is there a subdomain or folder you aren't linking to from the main site?
-
Hi Elisa,
It looks like it's pretty simple, when I crawl your Web site with Screaming Frog I only found 11 pages too. The reason is that the other pages aren't linked from the 11 pages found during a crawl. I would recommend to link to your other pages as well so these pages are found.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google not giving ranking to the intended page of my website.
Hello friends, This is my very first question, I hope I will explain my issue correctly. I have created two pages related to SSC CGL keyword on my website: https://www.ibtindia.com/ssc-cgl-notification-exam-date 2) https://www.ibtindia.com/ssc-cgl-apply-online I want to target the keyword SSC CGL Apply Online on the 2nd URL but Google is only considering the 1st page for all the "apply" related keywords as well. Can anyone suggest to me how to get the second page in rankings for its intended keywords? I will be very thankful for this help. I tried adding image but its showing dummy. Please you can check it op GOOGLE SERP Second page
Search Behavior | | namitathakur0 -
Creation of Landing Pages. Subdomain or something else?
Hi, I have an issue deciding how my landing pages should be like and I would like to ask for your help. Currently my landing pages are configured and presented like this: http://www.example.com/fra/Landing75.php?t_src=example&t=AFF&t_cre=keyboard-price&t_trm=160o600&B=1496&A=371&TargetURL= I would like to know if making a subdomain landing page is advised, maybe something like this: http://LandingPage.example.com/Landing75.php?t_src=example&t=AFF&t_cre=keyboard-price&t_trm=160o600&B=1496&A=371&TargetURL= Or if you suggest doing something else with my landing pages - I would like to know that as well. p.s. - How I tell the webmasters (my affiliates) to make a clickable button that won't be a direct link to my landing page but will be some form of non-visible redirect? Thanks in advance 🙂
Search Behavior | | JonsonSwartz0 -
Blocking links from being crawled
For my blog, should I block category, "read more" and author links from being crawled by search engine robots? Is it good for SEO? Thanks
Search Behavior | | uesat0 -
Looking for something better than Googles in page analytics
Buongiorno from 12 degrees C wetherby UK 🙂 I'm interested in measuring content engagagement, things like what gets clicked on mouse tracking beahaviour etc. Google Analytics in page analytics does a good job but is there another product able to guage user interactive behaviour with content (Yes ive added event tracking). Thanks in advance,
Search Behavior | | Nightwing
David1 -
Is putting/removing Adsense ads on the site affects crawling for seo?
Because I noticed when we totally remove Adsense ads on our site, the pages crawled per day on the google webmastertools suddenly dropped into noticable amount and we tested again to turn it on for a singe day, it jumped up again. So if Adsense affects crawling then, if we have adsense ad on all pages of the site the more chances it gets crawled by the bot? WS76R8w
Search Behavior | | CruiseControl0 -
When auditing a website, when do you decide to delete pages?
Given that the Panda algorithm includes engagement and user experience, when would you consider deleting a page that has poor engagement and conversion metrics? For example, consider a page that ranks well organically and receives (relatively) decent traffic from search. However, this page has poor engagement metrics compared to other pages on the site, does not convert visitors as well as other pages on the site, and doesn't have any external links. Would you consider deleting this page? Which metrics do you use when auditing a site and considering a web page from removal (bounce rate, average time on site, pages per visit, linking root domains, visits, revenue per visit, etc.)? Are some metrics weighed more than others? What kind of thresholds do you use? Finally, is there a situation when you would choose NOT to delete pages, even considering the above?
Search Behavior | | SAMarketing0 -
Does Page Load Time Affect SEO Rankings?
I was curious about how much page load times affect rankings. Here's what I did: I put together a lot of interactive media on specific landing pages Time-on-Page from organic visitors went from 50 seconds to average of 34 minutes Bounce Rate decreased by 20% Page Load time increased from 1 second to 6 seconds and at peak times to 8 seconds (on 56KB test) In the meantime the page was re-indexed and re-cached My question is three-fold: Would the time on page give higher rankings for keyword Would decreased bounce rate enhance rankings? Would the page load time decrease rankings? Did anyone do a similar test? What were the results?
Search Behavior | | HMCOE0 -
Irratic page rank results - why?
Hi, Hi- I've changed the title and reposted this question as I didn't get any insight. I really am going around in circles for this; so any help that can be given would be really appreciated.I know that you guys have the knowledge so really hoping you can share it! Thanks - background: I run two sites: www.ragsmetals.com and www.yourgoldfund.com: They offer similar products but to different markets: one is predominently trade, one predominently customer focused. They vie for the same keywords.e.g. Buy Gold My Issue: I have been trying to build www.yourgoldfund.com up from an SEO point of view; it is FALLING in the rankings; I am doing NOTHING with www.ragsmetals.com and it is rising in the rankings. I checked webmaster to see if there were any warnings as a result of penguin (found out how to do this on here - thanks for that!) there are none. I have optimized the pages a lot. I have put time into getting in bound traffic, and even more excitingly some experts (from reputable domains) have just linked to our site because they like our content! So to me things should be improving . NOTE: My OSE listed inbound links are incredibly diferent from google Webmaster. What can I do. I am a scientific person so I love the fact that I have 2 sites to compare...interested to hear your thoughts. Many thanks in advance
Search Behavior | | girlie0