Indexed URLs in Webmaster Tools
-
Hi everybody! I've been looking at my Webmaster Tools stats, and it looks like not all the URLs in the sitemap tree have been indexed, according to WMT at least. Is this reliable, and if so, is it worth investigating further?
|
|
|
|
|
|
|
| || |
Sitemap
|
Dec 15, 2011
|
2,000
|
1,309
|
| || |
Index
|
Dec 15, 2011
|
8,695
|
4,127
|
| || |
Sitemap
|
Dec 15, 2011
|
2,000
|
998
|
| || |
Sitemap
|
Dec 15, 2011
|
2,000
|
819
|
| || |
Sitemap
|
Dec 15, 2011
|
2,000
|
719
|
| || |
Sitemap
|
Dec 15, 2011
|
695
|
282
|
Thanks!
-
Hi,
Your example doesn't look out of the ordinary.
Submitting a sitemap doesn't automatically result in indexing of all pages. There are a number of factors that will influence which pages are indexed. These include predetermined allocations of crawl resources by the search engine, relevance/quality of content on the pages, accessibility etc.
As a site gains in popularity, adds and improves content etc then allocations and indexed pages can increase over time. If you see a sudden or significant decrease in the number of pages indexed (without any action by you to remove them) then you would need to start investigating what might be causing it.
If there are specific "money pages" that you are particularly concerned about you can manually check for them in search engines. If they are not returned in the result pages, that would indicate that they are not indexed. In this situation you can use manual indexing features to add individual URLs to both Google & Bing through WMT & Webmaster Central. To do this in Google, use "fetch as Googlebot" and once the URL is successfully fetched, you will be offered the option to add the URL to the index. There are monthly & daily limits on the number of URL's you can add this way.
Hope that helps,
Sha
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Looking for Third Party Tool Like Google Tag Manager
Hi All, Like google tag manager is there any tool or software or service available who can track my visitors each actions, events, clicks, after click what they do? But at same time like google tag manager it not slow down my site speed? I can say I am looking for tool which can main track different - different click on my pages. Any other suggestion pls share. Thanks!
Reporting & Analytics | | pragnesh96390 -
Google is not indexing all URLs
My website have company and events profile from 200 countries. So it does have lots of URL. Earlier in August 2014, Google used to crawl 90% of URLs we submit. Thing goes wrong when we shifted from http to https. We lost traffic. But we are gaining it slowly. Main concern is that, It still does not indexed all submitted URLs. It have crawled merely 8% of all URLs submitted. site address is businessvibes.com Any help would be appreciated.
Reporting & Analytics | | irteam0 -
URL Structure for Study Guides
I'm creating study guides for various musicals, plays and operas. A few issues: I want to easily view in Google Analytics data for all study guides, data at the category level (musical,play, opera) and data for an individual show. I want urls to be as short as possible for usability purposes. Some show titles are the same for shows in different categories. For example, there is the play Romeo and Juliet but there is also an opera Romeo and Juliet. Each study guide contains multiple sections that will live on different URLs (overview, context, plot summary, characters) What would be the ideal URL structure? Here's what I was currently thinking we should use: /show/play/romeo-juliet/ /show/play/romeo-juliet/context /show/play/romeo-juliet/plot /show/play/romeo-juliet/characters
Reporting & Analytics | | stageagent0 -
Page Views for a List of URL's (Excel & Analytics)
I've been playing around with a few excel plugins trying to get the visit count for over 350 different URL's on the same website. I cant seem to find a function that can do this. Can anyone advise a work around or a way i can achieve this? Greg
Reporting & Analytics | | AndreVanKets0 -
Keep multiple Google Analytic / Webmaster accounts seperate?
Hi, I have a paranoid suspicion that putting all my websites on one Webmaster / Analytic account will mean any links between my sites won't carry any weight, and Google might consider similar content much more readily if 2 of my sites are in the same market. So I have about 4 different accounts with my main sites split across them. Am I being over paranoid? Do any of you have any problem with all your sites being on the same account?
Reporting & Analytics | | SpecialCase0 -
Setting up Google Analytics default URL
If someone has set: the default url in Google Analytics to a non-www address (http://mysite.com) then placed the UA tracking script from that GA account within the CMS framework of the website... ... and then set the permanent 301 redirect in the htaccess file to redirect to the www address (http://www.mysite.com). How less accurrate will my GA analytics measurements be considering the default url within GA is non-www and the permanent 301 redirect in htacess is to the www-address? Anyone know how reliable GA reports are until the default url in GA analytics is changed to match what is the redirected url in htaccess file? _Cindy
Reporting & Analytics | | CeCeBar0 -
Analytics URL Tagging
For some reason I can't get Google Analytics to pick up my URL tags, am I doing something wrong? http://www.example.com/?utm_source=carscom&utm_campaign=3rdparty&utm_medium=referral
Reporting & Analytics | | kylesuss0 -
Phantom urls causing 404
I have a very strange problem. When I run SEOmoz diagnostics on my site, it reveals urls that I never created. It seems to combine two slugs into a new url. For example, I have created the pages http://www.naplesrealestatestars.com/abaco-bay-condos-naples/ and http://www.naplesrealestatestars.com/beachwalk-naples-florida/ and now the url http://www.naplesrealestatestars.com/abaco-bay-condos-naples/beachwalk-naples-florida/ exists in addition to the two I created. There are over 100 of these phantom urls and they all show a 404 error when clicked on or crawled by SEOmoz. Any body know how to correct this?
Reporting & Analytics | | DanBoyle760