Google Hiding Indexed Pages from SERPS?
-
Trying to troubleshoot an issue with one of our websites and noticed a weird discrepancy. Our site should only have 3 pages in the index. The main landing page with a contact form and two policy pages, yet google reports over 1,100 pages (that part is not a mystery, I know where they are coming from.....multi site installations of popular CMS's leave much to be desired in actually separating websites)
Here is a screen shot showing the results of the site command:
http://www.diigo.com/item/image/2jing/oseh
I have set my search settings to show 100 (the max number of results) results per page. Everything is fine until I get to page three where I get the standard "In order to show you the most relevant results, we have omitted some entries very similar to the 122 already displayed." But wait a second, I clicked on page three, now there are only two pages of results and the number of results reported has dropped to 122
http://www.diigo.com/item/image/2jing/r8c9
When I click on the "show omitted results" I do get some more results, and the returned results jumps back up to 1,100. However I only get three pages of results. And when I click on the last page the number of results returned changes to 205
http://www.diigo.com/item/image/2jing/jd4h
Is this a difference between indexes (same thing happens when I turn instant search back on, Shows over 1,100 results but when I get to the last page of results it changes to 205).
Any other way of getting this info? I am trying to go in and identify how these pages are being generated, but I have to know what ones are showing up in the index for that to happen. Only being able to access 1/5th of the pages indexed is not cool. Anyone have any idea about this or experience with it?
For reference I was going through with SEOmoz's excellent toolbar and exporting the results to csv (using the Mozilla plugin). I guess google doesn't like people doing that so maybe this is a way to protect against scraping by only showing limited results in the Site: command.
Thanks!
-
Thanks Alan,
will see what we can do. One way or the other it has to be addressed.
-
i see your problem, you may need to hack in and hard code the domain in the canonical tags.
-
High Alan,
thanks for the response, I guess it is good to know that someone else has seen this issue before.
As for canonical tags, I do have them on all pages, but because there is not a way to set them absolutely (our CMS only allows for relative....so it takes the base path of the domain that it is on) I can't get them to link only to the domain that they are supposed to be published on.
Cheers!
-
I have seen this and dont have an answer, but if i were you i would put canonical tags in your pages to avoide and problems with duplicate content as thats a lot of duplicates
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate pages coming from links from the login page - what should we do about them?
This is a follow on to an earlier question which was well answered by Dirk Ceuppens regarding abnormal crawl issues. We are seeing that the issues relating to Duplicate Pages are coming from links from the login page which shows information about where the user was redirected from. For example, if the visitor is not logged on and wishes to wish-list an item, they will be redirected to the login page, with the item code and intended action in the url; which can then continue on to the desired page once logged on. The MOZ crawler is seeing these pages as having Duplicated Content whilst they are all the same apart from a piece of information in the URL. Should we be blocking these duplications? Are they a risk to us? What should we be doing? Many thanks, Sarah
Moz Pro | | Mutatio_Digital0 -
Why has a .cleaning domain not been indexed on Google?
One of our clients domain names is http://companyname.cleaning I've done all of the on-page SEO, submitted a sitemap to Google and am currently monitoring the analytics and data on MozPro. The next scheduled update on domain authority is the 21st of July? We must have had this on since April, the website was most likely launched at the end of March. Is it normal to wait this long for a site to be indexed and the domain authority to rise?
Moz Pro | | birdmarketing0 -
404 : Errors in crawl report - all pages are listed with index.html on a WordPress site
Hi Mozers, I have recently submitted a website using moz, which has pulled up a second version of every page on the WordPress site as a 404 error with index.html at the end of the URL. e.g Live page URL - http://www.autostemtechnology.com/applications/civil-blasting/ Report page URL - http://www.autostemtechnology.com/applications/civil-blasting/index.html The permalink structure is set as /%postname%/ For some reason the report has listed every page with index.html at the end of the page URL. I have tried a number of redirects in the .htaccess file but doesn't seem to work. Any suggestions will be strongly appreciated. Thanks
Moz Pro | | AmanziDigital0 -
Google Analytics
Hi, One of my clients is trying to make me a user of his Google Analytic account so I can run a report for him on SEOmoz. When he tries to add me it says invalid email ? My email is a googlemail account, what am i doing wrong ? Thanks James
Moz Pro | | Stoz0 -
Grade F pages - all first in Google
Any anyone explain what value the Grade pages are if, as in my case, I have 9 Grade F pages of which 4 are in first position on Google, 1 is in second and the rest are 4th! I understand why SEOM might be flagging them as Grade F (keyword use in tags etc), but it seems it must be looking at the wrong clues if it still thinks that its recommendations are the most relevant to improving position. These are not obscure terms (Spy devices, electronic surveillance, spy systems, surveillance systems) for a UK site (www.spycatcheronline.co.uk) I appreciate that the points highlighted may need to be addressed, but clearly the pages/site are doing something right to come first - does this not devalue the whole Grade system on SEOM? Charles.
Moz Pro | | MrFrisbee1 -
"Too many on-page links" warning on all of my Wordpress pages
Hey guys, I've got like 120 "Too many on-page links" warnings in my crawl diagnostics section. They're all the pages of my WordPress blog. Is this an acceptable and expected warning for Wordpress or does something need to be better optimized? Thanks.
Moz Pro | | SheffieldMarketing0 -
Does the keyword tracker take into account google base?
i just wanted to know if the ranking number allows for google products aswell?
Moz Pro | | DaveDawson0