Hi all

I'm wanting to find out from those who have experience dealing with large sites (10s/100s of millions of pages).

What's a typical (or highest) percentage of indexed pages vs. submitted pages you've seen? This information can be found in webmaster tools where Google shows you the pages submitted & indexed for each of your sitemap.

I'm trying to figure out whether,

• The average index % out there
• There is a ceiling (i.e. will never reach 100%)
• It's possible to improve the indexing percentage further

Just to give you some background, sitemap index files (according to schema.org) have been implemented to improve crawl efficiency and I'm wanting to find out other ways to improve this further.

I've been thinking about looking at the URL parameters to exclude as there are hundreds (e-commerce site) to help Google improve crawl efficiency and utilise the daily crawl quote more effectively to discover pages that have not been discovered yet.

However, I'm not sure yet whether this is the best path to take or I'm just flogging a dead horse if there is such a ceiling or if I'm already at the average ballpark for large sites.

Any suggestions/insights would be appreciated. Thanks.