Only 11 pages being crawled
-
Hi,
Can some one have a look and see why out of 400+ pages we only have 11 being crawled on here??
http://www.lifetimelegal.co.uk
Kind Regards
Elissa
-
When I search your site in Google it shows me 82 results against my query “site:domain.com” so it seems like Google is slowly crawling your site but you are right the rate of crawling pages is quite slow and to increase this here are few things that you should follow
- Strong Internal Linking
It is important to have a strong internal linking between the pages if you want Google and other search engine to crawl your page. Please check if you have a strong and powerful internal linking between the pages
- Xml Sitemap
The other thing that is missing on your site is xml sitemap. The idea is to add an xml sitemap and add it in Google webmaster tool and this will indicate Google to crawl different areas of your website with no hassle
Hope this will help!
-
Just looking around your site, the code seems ok - to a large extent.
But you are missing a sitemap (handy to point to all urls) and a robots.txt file
Also just clicking around i don't see 400 pages? is there a subdomain or folder you aren't linking to from the main site?
-
Hi Elisa,
It looks like it's pretty simple, when I crawl your Web site with Screaming Frog I only found 11 pages too. The reason is that the other pages aren't linked from the 11 pages found during a crawl. I would recommend to link to your other pages as well so these pages are found.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Viewing search results for 'When searching in google we find our site in the first position but when some others search it is seen on the second page 1 st position why is this happening?'
Viewing search results for 'When searching in google we find our site in the first position but when some others search it is seen on the second page 1 st position why is this happening?'
Search Behavior | | Alyaauditors0 -
Bounce Rate: Would GA consider a user interacting with a single page (i.e expanding text), before exiting a bounce?
Hey guys, I have done a ton of research regarding bounce rates, yet I cannot seem to find the answer I'm after. Senario: BoIf a user follows a link and lands on a product results page with various sets of filters and an "apply" button, looks through the site, adjusts the filter functions (without changing the url structure) and exists without going to another page - would that qualify as a bounce in Google Analytics? For example: If I click 'details' to see expandable text on a results page ( /credit-cards). The dynamic url I'm talking about is below: https://masii.co.th/thai-en/credit-card/compare-buy?category=shopping%2Ccashback%2Cair_miles%2Cassistance%2Cdining%2Cpetrol%2Crewards&income=30000
Search Behavior | | Masii0 -
Is it better to find a page without the desired content, or not find the page?
Are there any studies that show which is best? If you find my page but not the specific thing you want on it, you may still find something of value. But, if you don't you may associate my site with poor results, which can be worse than finding what you want at a competitor site. IOW maybe it is best to have pages that ONLY and ALWAYS have the content desired. What do the studies suggest? I'm asking because I have content that maybe 1/3 of the time exists and 2/3 of the time doesn't...think 'out of stock' products. So, I'm wondering if I should look into removing the page from being indexed during the 2/3 or should keep it. If I remove it then my concern is whether I lose the history/age factor that I've read Google finds important for credibility. Your thoughts?
Search Behavior | | friendoffood0 -
Creation of Landing Pages. Subdomain or something else?
Hi, I have an issue deciding how my landing pages should be like and I would like to ask for your help. Currently my landing pages are configured and presented like this: http://www.example.com/fra/Landing75.php?t_src=example&t=AFF&t_cre=keyboard-price&t_trm=160o600&B=1496&A=371&TargetURL= I would like to know if making a subdomain landing page is advised, maybe something like this: http://LandingPage.example.com/Landing75.php?t_src=example&t=AFF&t_cre=keyboard-price&t_trm=160o600&B=1496&A=371&TargetURL= Or if you suggest doing something else with my landing pages - I would like to know that as well. p.s. - How I tell the webmasters (my affiliates) to make a clickable button that won't be a direct link to my landing page but will be some form of non-visible redirect? Thanks in advance 🙂
Search Behavior | | JonsonSwartz0 -
Does Page Load Time Affect SEO Rankings?
I was curious about how much page load times affect rankings. Here's what I did: I put together a lot of interactive media on specific landing pages Time-on-Page from organic visitors went from 50 seconds to average of 34 minutes Bounce Rate decreased by 20% Page Load time increased from 1 second to 6 seconds and at peak times to 8 seconds (on 56KB test) In the meantime the page was re-indexed and re-cached My question is three-fold: Would the time on page give higher rankings for keyword Would decreased bounce rate enhance rankings? Would the page load time decrease rankings? Did anyone do a similar test? What were the results?
Search Behavior | | HMCOE0 -
Forced Page Views and Search Engines?
I have a website that was built for the primary purpose of showing HTML 5 capabilities. With this, we have to create forced page views within analytics in order to receive any data about consumer behavior on the site. Are search engines viewing these forced page views as actual webpages? Does it even effect SEO efforts?
Search Behavior | | HughesDigital0 -
Home page (s) deindexed
Ok odd one. 2 sites hosted on go daddy, neither sites has any cause for concern. But both sites have had there home pages deindexed or - 10000 penalty for no reason. We do the SEO for 1 site and not for the other. The server is shared with go daddy no idea on how many other 3rd party sites are on it. I've filed a reinclusion request for both sites. Any help is more than welcome.
Search Behavior | | therealmarkhall0 -
How to optimize a Stock Symbol page?
Hi, My website is for stock picking. The keywords in each stock page are stock symbol. Now the stock symbol rank of my website in google is around 30-50. I use On-Page Keyword Optimization tool on seomoz to optimize those page. Now all stock symbol pages are Grade A in on-page report card. Is there other suggestions to increase stock symbol page ranking? Thanks in advance! -Don
Search Behavior | | dodoflying0