Is the Google results serp broken?
-
Hi everyone!
We've been trying to decipher how many of our pages are indexed by google at the moment. If we do the usual "site:https://www.hobbydb.com" search term, the serp says that we have more than 740,000 pages indexed. However, when I do a deep dive and click through to the last page of results, I can only get to page 54, and then there are no more results. This would mean that I only have 540 pages indexed, not 740,000. We have also done other queries for other sub-sections of our website, and the results also truncate at 50 pages. Has anyone run into this problem? Any suggestions are appreciated!
Best,
Alex
-
Google search console Index Status report
Google Webmaster tools tell you in the
https://support.google.com/webmasters/answer/2642366?hl=en
if you want to know without a doubt you have to connect Google Analytics to Deepcrawl it will say exactly how many URLs are in the index.
- https://www.deepcrawl.com
- https://www.deepcrawl.com/knowledge/best-practice/how-to-measure-indexed-pages-more-accurately/
- https://www.deepcrawl.com/knowledge/best-practice/how-can-non-indexable-pages-receive-google-organic-traffic/
- http://www.stateofdigital.com/40-deepcrawl-tweaks/
Now that Google Analytics can be added to screaming frog you can do something very similar.
- https://www.screamingfrog.co.uk/seo-spider/
- https://www.screamingfrog.co.uk/seo-spider/user-guide/general/#crawling
- https://www.screamingfrog.co.uk/seo-spider/faq/
- https://moz.com/community/q/how-to-determine-which-pages-are-not-indexed
I Hope this helps,
Tom
-
Michael, the site: command typically has not "worked" or provided accurate results for years now. It's just they way it is--and I don't expect Google to really give us the number of pages that are actually indexed anytime soon.
That said, typically I recommend using the site:hobbydb.com command to see the pages, and then click to the final page of results (if you can). I'm currently seeing about 766,000 pages indexed.
-
That index query returns dubious results. URLProfiler wrote an excellent article last year sharing the results of some experimentation they did around the accuracy of that command and other tools used to help determine the extent of your site indexation. I recommend you give it a read - http://urlprofiler.com/blog/google-index-checker/. It will take some some work and access to their tool, but I think you'll gain a lot of insight.
Good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Does not find Internal links
Hi guys I involved in difficult situation. in google webmaster tools -> internal links some important pages doesn't have any links from all pages. for example home page just have 9000 internal inks but there are 29000 indexed pages by google and some not important pages have 27000 internal links.(more than home page) Site made by angular v1 Is there anyone can help me why google could not find all internal links?
Technical SEO | | cafegardesh0 -
Paid Links - How does Google classify them?
Greetings All, I have a question regarding "Paid Links." My company creates custom websites for other small businesses across the country. We always have backlinks to our primary website from our "Dealer Sites." Would Google and other search engines consider links from our "dealer sites" to be "paid links?" Example:
Technical SEO | | CFSSEO
http://www.atlanticautoinc.com/ is the "dealer site." Would Google consider the links from Atlantic Auto to be a "paid link," and therefor have less of an impact for page rankings, due to it not being organic? Any insight on this matter would be greatly appreciated. Thank you!!!0 -
Duplicate content with "no results found" search result pages
We have a motorcycle classifieds section that lets users search for motorcycles for sale using various drop down menus to pick year-make-type-model-trim, etc.. These search results create urls such as:
Technical SEO | | seoninjaz
www.example.com/classifieds/search.php?vehicle_manufacturer=Triumph&vehicle_category=On-Off Road&vehicle_model=Tiger&vehicle_trim=800 XC ABS We understand that all of these URL varieties are considered unique URLs by Google. The issue is that we are getting duplicate content errors on the pages that have no results as they have no content to distinguish themselves from each other. A URL like:
www.example.com/classifieds/search.php?vehicle_manufacturer=Triumph&vehicle_category=Sportbike
and
www.example.com/classifieds/search.php?vehicle_manufacturer=Honda&vehicle_category=Streetbike Will have a results page that says "0 results found". I'm wondering how we can distinguish these "unique" pages better? Some thoughts:
-make sure <title>reflects what was search<br />-add a heading that may say "0 results found for Triumph On-Off Road Tiger 800 XC ABS"<br /><br />Can anyone please help out and lend some ideas in solving this? <br /><br />Thank you.</p></title>0 -
Google Index Speed Opinions
Hello Everyone, Under normal circumstances, new posts to my site are indexed almost instantly by Google. I know this because an occasional search with quotation marks surrounding the 1st paragraph of text displays my newly published page. I use this tactic from time to time to ensure contributors aren't syndicating content. My question is this: I've noticed over the last day or so that my newly published articles are not yet indexed. For example, an article that was published over 24 hours ago does not appear to be indexed yet. Is this cause for concern? Is there an average wait time for indexation? XML issue? Thanks in advance for the help/insight.
Technical SEO | | JSOC0 -
How to avoid automated queries to Google
We have a search engine marketing team working on different projects and we share same IP. We check our rankings manually on Google, is it sending automated queries to Google? Can it affect our sites? What solution do you suggest to check rankings without sending multiple queries to Google?
Technical SEO | | koamit0 -
Google Webmaster tools error?
So I am trying to set the URL preference in google webmaster tools for my site. However when I try to save it it tells me to verify that I own the site. I have already done this so where can I go to verify I own the site exactly? Maybe I am wrong and I have not done this already but even on the homepage of webmaster tools I don't see an option to "verify".
Technical SEO | | ENSO0 -
Look of google results
Can anyone tell me why some google results show the main page and then a listing of all subsequent pages (i.e. results for SEOMOZ) while others just show the main page with nothing under it. I have two different sites (one personal the other biz) and they both show their search results differently. Is it something in the site creation or how it is crawled by google? Thanks. bKs3C
Technical SEO | | STF0 -
I have a SERP result thats started returning a dud URL all of a sudden, any ideas why?
SERP "French Furniture" in google.co.uk The URL thats started to be returned P7 is <cite>www.thefurnituremarket.co.uk/ categories.asp?cat=</cite> The meta description is relevant however our CMS system 'ecommerce templates' has some code in it to return a dynamic meta description dependant on what catergory is being searched. It seems that the meta description is being populated from our french furniture category but the URL is not dynamic.. This has only started happening this past week. usually the url http://www.thefurnituremarket.co.uk/french_furniture.asp is returned. in WMT is is nicely indexing with 5 links... on it's own... Any ideas?
Technical SEO | | robertrRSwalters0