Indexed URLs in Webmaster Tools
-
Hi everybody! I've been looking at my Webmaster Tools stats, and it looks like not all the URLs in the sitemap tree have been indexed, according to WMT at least. Is this reliable, and if so, is it worth investigating further?
|
|
|
|
|
|
|
| || |
Sitemap
|
Dec 15, 2011
|
2,000
|
1,309
|
| || |
Index
|
Dec 15, 2011
|
8,695
|
4,127
|
| || |
Sitemap
|
Dec 15, 2011
|
2,000
|
998
|
| || |
Sitemap
|
Dec 15, 2011
|
2,000
|
819
|
| || |
Sitemap
|
Dec 15, 2011
|
2,000
|
719
|
| || |
Sitemap
|
Dec 15, 2011
|
695
|
282
|
Thanks!
-
Hi,
Your example doesn't look out of the ordinary.
Submitting a sitemap doesn't automatically result in indexing of all pages. There are a number of factors that will influence which pages are indexed. These include predetermined allocations of crawl resources by the search engine, relevance/quality of content on the pages, accessibility etc.
As a site gains in popularity, adds and improves content etc then allocations and indexed pages can increase over time. If you see a sudden or significant decrease in the number of pages indexed (without any action by you to remove them) then you would need to start investigating what might be causing it.
If there are specific "money pages" that you are particularly concerned about you can manually check for them in search engines. If they are not returned in the result pages, that would indicate that they are not indexed. In this situation you can use manual indexing features to add individual URLs to both Google & Bing through WMT & Webmaster Central. To do this in Google, use "fetch as Googlebot" and once the URL is successfully fetched, you will be offered the option to add the URL to the index. There are monthly & daily limits on the number of URL's you can add this way.
Hope that helps,
Sha
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website excluded from indexing, google-selected canonical: N/A
The google search console revealed to me that none of my pages was indexed, all pages are listed in the 'excluded' section "duplicate, google chose different canonical than user".
Reporting & Analytics | | Fibigrus
But in the URL-inspection tab it shows me google-selected canonical: N/A Indexing and crawling is both allowed. Don't know how to get my pages to be indexed correctly. (by the way, they do NOT exist in other languages, so that can't be a reason why google might think they are a duplicate. There's definitively no other version of those pages available)0 -
Which page speed tools do you trust?
We are at a loss. We have been following Google Pagespeed Insights which gives us horrible marks. Nothing we do seems to really make a difference. GTMetrix and Pingdom give us much better scores. We don't know what to do...
Reporting & Analytics | | HashtagHustler0 -
Site Hacked: Is it Faster and Better to 301 or 404 Irrelevant URLs?
Hey Everyone, So our site was hacked which created a large amount of irrelevant URLs on our domain; resulting in thousands of 404 errors and pages coming up for searches unrelated to our brand. The question is now that the issues have been resolved (and site re-submitted) would it be quicker (and more ideal) to redirect important 404 errors that see traffic, have links…etc. although not relevant or just let everything 404 out? We’re not as concerned with offering a relevant user experience because these are not in our demographic but want to avoid these pages convoluting our analytics as well as issues that might arise from Google thinking these topics do apply. Any help or insight would be very appreciated. Please let us know if you have any questions, concerns or we could provide further details that might help. Looking forward to hearing from all of you! Thanks in advance. Best,
Reporting & Analytics | | Ben-R0 -
Webmaster Tools equivalent to Change Default Address found in Analytics
Hello all! We're changing from http to https. In Google Analytics there is an option to change the default address so we keep our historical data. I can't find a similar option in Webmaster Tools though. Do you have to setup a new property or is there an option to change your current one? Thanks in advance!
Reporting & Analytics | | thegrbteam0 -
How to get multiple pages to appear under main url in search - photo attached
How do you get a site to have an organized site map under the main url when it is searched as in the example photo? SIte-map.png
Reporting & Analytics | | marketingmediamanagement0 -
Tools For Analysing Backlinks
Does anyone know of a good tool that analyses backlinks? I have already tried Link Research Tools and found it very useful but it is very expensive. Does anyone know of an alternative that does the same thing, i.e. will tell you what links are causing harm to your site?
Reporting & Analytics | | AAttias0 -
Google Webmaster not accounting for internal links
Hi SEO gurus! All my websites in GWT show the website in question at the top of the "Links to your site", in the form of: Domains Total links my-site.com 1,000 third-party-1.com 500 third-party-2.com 300 third-party-3.com 200 etc.com 100 However, I have a specific account that suddenly (a few weeks back) disappeared its own link count: Domains Total links third-party-1.com 500 third-party-2.com 300 third-party-3.com 200 etc.com 100 Has this happened to any of you? Any ideas how to solve it? The website is www.gmvbodybuilding.com which you can see has plenty of properly formed links.
Reporting & Analytics | | hectorpn0 -
Search within search? Weird google URLs
Good morning afternoon, how are you guys doing today? I'm experiencing a few Panda issues I'm trying to fix, and I was hoping I could get some help here about one of my problems. I used Google analytics to extract pages people land on after a Google search. I'm trying to identify thin pages that potentially harm my website as a whole. It turns out I have a bunch of pages in the likes of the following: /search?cd=15&hl=en&ct=clnk&gl=uk&source=www.google .co.uk, and so on for a bunch of countries (.fi, .com, .sg, .pk, and so on, maybe 50 of them) My question is: what are those pages? their stats are awful, usually 1 visitor, 100% bounce rate, and 0 links. Do you think they can explain my dramatic drop in traffic following Panda? If so, what should I do with them? NOINDEX? Deletion? What would you suggest? I also have a lot of links in the likes of the following: /google-search?cx=partner-pub-6553421918056260:armz8yts3ql&cof=FORID:10&ie=ISO-8859-1&sa=Search&siteurl=www.mysite.com/content/article They lead to custom search pages. What should I do with them? Almost two weeks ago, Dr. Pete posted an article untitled Fat Panda and Thin Content in which he deals with "search within search" and how they might be targeted by Panda. Do you think this is the issue I'm facing? Any suggestion/help would be much appreciated! Thanks a lot and have a great day 🙂
Reporting & Analytics | | Ericc220