undefined
Skip to content
Moz logo Menu open Menu close
  • Products
    • Moz Pro
    • Moz Pro Home
    • Moz Local
    • Moz Local Home
    • STAT
    • Moz API
    • Moz API Home
    • Compare SEO Products
    • Moz Data
  • Free SEO Tools
    • Domain Analysis
    • Keyword Explorer
    • Link Explorer
    • Competitive Research
    • MozBar
    • More Free SEO Tools
  • Learn SEO
    • Beginner's Guide to SEO
    • SEO Learning Center
    • Moz Academy
    • SEO Q&A
    • Webinars, Whitepapers, & Guides
  • Blog
  • Why Moz
    • Agency Solutions
    • Enterprise Solutions
    • Small Business Solutions
    • Case Studies
    • The Moz Story
    • New Releases
  • Log in
  • Log out
  • Products
    • Moz Pro

      Your all-in-one suite of SEO essentials.

    • Moz Local

      Raise your local SEO visibility with complete local SEO management.

    • STAT

      SERP tracking and analytics for enterprise SEO experts.

    • Moz API

      Power your SEO with our index of over 44 trillion links.

    • Compare SEO Products

      See which Moz SEO solution best meets your business needs.

    • Moz Data

      Power your SEO strategy & AI models with custom data solutions.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Free SEO Tools
    • Domain Analysis

      Get top competitive SEO metrics like DA, top pages and more.

    • Keyword Explorer

      Find traffic-driving keywords with our 1.25 billion+ keyword index.

    • Link Explorer

      Explore over 40 trillion links for powerful backlink data.

    • Competitive Research

      Uncover valuable insights on your organic search competitors.

    • MozBar

      See top SEO metrics for free as you browse the web.

    • More Free SEO Tools

      Explore all the free SEO tools Moz has to offer.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Learn SEO
    • Beginner's Guide to SEO

      The #1 most popular introduction to SEO, trusted by millions.

    • SEO Learning Center

      Broaden your knowledge with SEO resources for all skill levels.

    • On-Demand Webinars

      Learn modern SEO best practices from industry experts.

    • How-To Guides

      Step-by-step guides to search success from the authority on SEO.

    • Moz Academy

      Upskill and get certified with on-demand courses & certifications.

    • MozCon

      Save on Early Bird tickets and join us in London or New York City

    Unlock flexible pricing & new endpoints
    Moz API

    Unlock flexible pricing & new endpoints

    Find your plan
  • Blog
  • Why Moz
    • Small Business Solutions

      Uncover insights to make smarter marketing decisions in less time.

    • Agency Solutions

      Earn & keep valuable clients with unparalleled data & insights.

    • Enterprise Solutions

      Gain a competitive edge in the ever-changing world of search.

    • The Moz Story

      Moz was the first & remains the most trusted SEO company.

    • Case Studies

      Explore how Moz drives ROI with a proven track record of success.

    • New Releases

      Get the scoop on the latest and greatest from Moz.

    Surface actionable competitive intel
    New Feature

    Surface actionable competitive intel

    Learn More
  • Log in
    • Moz Pro
    • Moz Local
    • Moz Local Dashboard
    • Moz API
    • Moz API Dashboard
    • Moz Academy
  • Avatar
    • Moz Home
    • Notifications
    • Account & Billing
    • Manage Users
    • Community Profile
    • My Q&A
    • My Videos
    • Log Out

The Moz Q&A Forum

  • Forum
  • Questions
  • Users
  • Ask the Community

Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

  1. Home
  2. SEO Tactics
  3. Intermediate & Advanced SEO
  4. Indexed Pages in Google, How do I find Out?

Moz Q&A is closed.

After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

Indexed Pages in Google, How do I find Out?

Intermediate & Advanced SEO
5
12
16.3k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as question
Log in to reply
This topic has been deleted. Only users with question management privileges can see it.
  • JohnPeters
    JohnPeters last edited by Nov 28, 2012, 4:59 AM

    Is there a way to get a list of pages that google has indexed?

    Is there some software that can do this?

    I do not have access to webmaster tools, so hoping there is another way to do this.

    Would be great if I could also see if the indexed page is a 404 or other

    Thanks for your help, sorry if its  basic question 😞

    1 Reply Last reply Reply Quote 0
    • askshopper
      askshopper last edited by Nov 28, 2012, 1:08 PM Nov 28, 2012, 1:08 PM

      If you want to find all your indexed pages in Google just type:  site:yourdomain.com or .co.uk or other  without the www.

      1 Reply Last reply Reply Quote 0
      • SebastianCowie
        SebastianCowie last edited by Nov 28, 2012, 6:55 AM Nov 28, 2012, 6:55 AM

        Hi John,

        Hope I'm not too late to the party! When checking URL's for their cache status I suggest using Scrapebox (with proxies).

        Be warned, it was created as a black-hat tool, and as such is frowned upon, but there are a number of excellent white-hat uses for it! Costs $57 one off 😉

        1 Reply Last reply Reply Quote 1
        • BlueprintMarketing
          BlueprintMarketing @JohnPeters last edited by Nov 28, 2012, 5:54 AM Nov 28, 2012, 5:54 AM

          sorry to keep sending you messages but I wanted to make sure that you know SEOmoz does have a fantastic tool for what you are requesting. Please look at this link and then click on the bottom where it should says show more and I believe you will agree it does everything you've asked and more.

          http://pro.seomoz.org/tools/crawl-test

          Sincerely,

          Thomas

          does this answer your question?

          1 Reply Last reply Reply Quote -1
          • BlueprintMarketing
            BlueprintMarketing @JohnPeters last edited by Nov 28, 2012, 5:30 AM Nov 28, 2012, 5:30 AM

            What giving you a 100 limit?

            try using Raven tools or spider mate they both have excellent free trials and allow you quite a bit of information.

            1 Reply Last reply Reply Quote 0
            • BlueprintMarketing
              BlueprintMarketing @riplash last edited by Nov 28, 2012, 5:28 AM Nov 28, 2012, 5:28 AM

              Neil you are correct I agree with screaming frog is excellent they definitely will show you your site. Here is a link from SEOmoz associate that I believe will benefit you

              http://www.seomoz.org/q/404-error-but-i-can-t-find-any-broken-links-on-the-referrer-pages

              sincerely,

              Thomas

              1 Reply Last reply Reply Quote 0
              • JohnPeters
                JohnPeters @riplash last edited by Nov 28, 2012, 5:27 AM Nov 28, 2012, 5:27 AM

                this is what I am looking for 🙂 Thanks

                Strange that there is no tool I can buy to do this in full without the 100 limit

                Anyway, i will give that a go

                BlueprintMarketing 1 Reply Last reply Nov 28, 2012, 5:30 AM Reply Quote 0
                • BlueprintMarketing
                  BlueprintMarketing @JohnPeters last edited by Nov 28, 2012, 5:26 AM Nov 28, 2012, 5:26 AM

                  can I get your sites URL? By the way this might be a better way into Google Webmaster tools

                  https://accounts.google.com/ServiceLogin?service=sitemaps&passive=1209600&continue=https://www.google.com/webmasters/tools/&followup=https://www.google.com/webmasters/tools/

                  if you have a Gmail account use that if you don't just sign up using your regular e-mail.

                  Of course using SEOmoz via http://pro.seomoz.org/tools/crawl-test  will give you a full rundown of all of your links and how they're running. Are you not seen all of them?

                  Another tool I have found very useful. Is website analysis as well as their midsize product from Alexia

                  http://www.alexa.com/products

                  I hope I have helped,

                  Tom

                  1 Reply Last reply Reply Quote -1
                  • riplash
                    riplash last edited by Nov 28, 2012, 5:28 AM Nov 28, 2012, 5:25 AM

                    If you don't have access to Webmaster Tools, the most basic way to see which pages Google has indexed is obviously to do a site: search on Google itself - like "site:google.com" - to return pages of SERPs containing the pages from your site which Google has indexed.

                    Problem is, how do you get the data from those SERPs in a useful format to run through Screaming Frog or similar?

                    Enter Chris Le's Google Scraper for Google Docs

                    It will let scrape the first 100 results, then let you offset your search by 100 and get the next 100, etc.. slightly cumbersome, but it will achieve what you want to do.

                    Then you can crawl the URLs using Screaming Frog or another crawler.

                    JohnPeters BlueprintMarketing 2 Replies Last reply Nov 28, 2012, 5:28 AM Reply Quote 1
                    • BlueprintMarketing
                      BlueprintMarketing last edited by Nov 28, 2012, 5:21 AM Nov 28, 2012, 5:21 AM

                      just thought I might add these links these might help explain it better than I did.

                      http://support.google.com/webmasters/bin/answer.py?hl=en&answer=1352276

                      http://support.google.com/webmasters/bin/answer.py?hl=en&answer=2409443&topic=2446029&ctx=topic

                      http://pro.seomoz.org/tools/crawl-test

                      you should definitely sign up for Google Webmaster tools it is free here is a link all you need to do is add an e-mail address and password

                      http://support.google.com/webmasters/bin/topic.py?hl=en&topic=1724121

                      I hope I have been of help to you sincerely,

                      Thomas

                      1 Reply Last reply Reply Quote -1
                      • JohnPeters
                        JohnPeters @BlueprintMarketing last edited by Nov 28, 2012, 5:17 AM Nov 28, 2012, 5:17 AM

                        Thanks for the reply.

                        I do not have access to webmaster tools and the seomoz tools do not show a great deal of the pages on my site for some reason

                        Majestic shows up to 100 pages. Ahrefs shows some also.

                        I need to compare what google has indexed and the status of the page

                        Does screaming frog do thiss?

                        BlueprintMarketing 2 Replies Last reply Nov 28, 2012, 5:54 AM Reply Quote 0
                        • BlueprintMarketing
                          BlueprintMarketing last edited by Nov 28, 2012, 5:13 AM Nov 28, 2012, 5:13 AM

                          Google Webmaster tools should supply you with this information. In addition Seomoz tools will tell you that and more. Run your website through the campaign section of seomoz you will then see any issues with your website.

                          You may also want to of course use Google Webmaster tools run a test as a Google bot the Google but should show you any issues you are having such is 404's or other fun things that websites do.

                          If you're running WordPress there are plenty of plug-ins I recommend 404 returned

                          sincerely,

                          Thomas

                          JohnPeters 1 Reply Last reply Nov 28, 2012, 5:17 AM Reply Quote -1
                          • 1 / 1
                          1 out of 12
                          • First post
                            1/12
                            Last post

                          Got a burning SEO question?

                          Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


                          Start my free trial


                          Browse Questions

                          Explore more categories

                          • Moz Tools

                            Chat with the community about the Moz tools.

                          • SEO Tactics

                            Discuss the SEO process with fellow marketers

                          • Community

                            Discuss industry events, jobs, and news!

                          • Digital Marketing

                            Chat about tactics outside of SEO

                          • Research & Trends

                            Dive into research and trends in the search industry.

                          • Support

                            Connect on product support and feature requests.

                          • See all categories

                          Related Questions

                          • McTaggart

                            How to stop URLs that include query strings from being indexed by Google

                            Hello Mozzers Would you use rel=canonical, robots.txt, or Google Webmaster Tools to stop the search engines indexing URLs that include query strings/parameters. Or perhaps a combination? I guess it would be a good idea to stop the search engines crawling these URLs because the content they display will tend to be duplicate content  and of low value to users. I would be tempted to use a combination of canonicalization and robots.txt for every page I do not want crawled or indexed, yet perhaps Google Webmaster Tools is the best way to go / just as effective??? And I suppose some use meta robots tags too. Does Google take a position on being blocked from web pages. Thanks in advance, Luke

                            Intermediate & Advanced SEO | Mar 15, 2017, 9:04 PM | McTaggart
                            0
                          • ioannisa

                            Mass Removal Request from Google Index

                            Hi, I am trying to cleanse a news website.  When this website was first made, the people that set it up copied all kinds of articles they had as a newspaper, including tests, internal communication, and drafts.  This site has lots of junk, but this kind of junk was on the initial backup, aka before 1st-June-2012.  So, removing all mixed content prior to that date, we can have pure articles starting June 1st, 2012! Therefore My dynamic sitemap now contains only articles with release date between 1st-June-2012 and now Any article that has release date prior to 1st-June-2012 returns a custom 404 page with "noindex" metatag, instead of the actual content of the article. The question is how I can remove from the google index all this junk as fast as possible that is not on the site anymore, but still appears in google results? I know that for individual URLs I need to request removal from this link
                            https://www.google.com/webmasters/tools/removals The problem is doing this in bulk, as there are tens of thousands of URLs I want to remove.  Should I put the articles back to the sitemap so the search engines crawl the sitemap and see all the 404?  I believe this is very wrong.  As far as I know this will cause problems because search engines will try to access non existent content that is declared as existent by the sitemap, and return errors on the webmasters tools. Should I submit a DELETED ITEMS SITEMAP using the <expires>tag? I think this is for custom search engines only, and not for the generic google search engine.
                            https://developers.google.com/custom-search/docs/indexing#on-demand-indexing</expires> The site unfortunatelly doesn't use any kind of "folder" hierarchy in its URLs, but instead the ugly GET params, and a kind of folder based pattern is impossible since all articles (removed junk and actual articles) are of the form:
                            http://www.example.com/docid=123456 So, how can I bulk remove from the google index all the junk... relatively fast?

                            Intermediate & Advanced SEO | Apr 15, 2016, 5:45 PM | ioannisa
                            0
                          • lunavista-comm

                            Why is Google ranking irrelevant / not preferred pages for keywords?

                            Over the past few months we have been chipping away at duplicate content issues. We know this is our biggest issue and is working against us. However, it is due to this client also owning the competitor site. Therefore, product merchandise and top level categories are highly similar, including a shared server. Our rank is suffering major for this, which we understand.  However, as we make changes, and I track and perform test searches, the pages that Google ranks for keywords never seems to match or make sense, at all. For example, I search for "solid scrub tops" and it ranks the "print scrub tops" category. Or the "Men Clearance" page is ranking for  keyword "Women Scrub Pants". Or, I will search for a specific brand, and it ranks a completely different brand. Has anyone else seen this behavior with duplicate content issues?  Or is it an issue with some other penalty?  At this point, our only option is to test something and see what impact it has, but it is difficult to do when keywords do not align with content.

                            Intermediate & Advanced SEO | Dec 1, 2015, 7:53 PM | lunavista-comm
                            0
                          • maxweb

                            Links from non-indexed pages

                            Whilst looking for link opportunities, I have noticed that the website has a few profiles from suppliers or accredited organisations. However, a search form is required to access these pages and when I type cache:"webpage.com" the page is showing up as non-indexed. These are good websites, not spammy directory sites, but is it worth trying to get Google to index the pages? If so, what is the best method to use?

                            Intermediate & Advanced SEO | Apr 22, 2014, 1:32 PM | maxweb
                            0
                          • fablau

                            Google Analytics: how to filter out pages with low bounce rate?

                            Hello here, I am trying to find out how I can filter out pages in Google Analytics according to their bounce rate. The way I am doing now is the following: 1. I am working inside the Content > Site Content > Landing Pages report 2. Once there, I click the "advanced" link on the right of the filter field. 3. Once there, I define to "include" "Bounce Rate" "Greater than" "0.50" which should show me which pages have a bounce rate higher of 0.50%.... instead I get the following warning on the graph: "Search constraints on metrics can not be applied to this graph" I am afraid I am using the wrong approach... any ideas are very welcome! Thank you in advance.

                            Intermediate & Advanced SEO | Jun 27, 2013, 12:57 PM | fablau
                            0
                          • PepMozBot

                            How long does google take to show the results in SERP once the pages are indexed ?

                            Hi...I am a newbie & trying to optimize the website www.peprismine.com. I have 3 questions - A little background about this : Initially, close to 150 pages were indexed by google. However, we decided to remove close to 100 URLs (as they were quite similar). After the changes, we submitted the NEW sitemap (with close to 50 pages) & google has indexed those URLs in sitemap. 1. My pages were indexed by google few days back. How long does google take to display the URL in SERP once the pages get indexed ? 2. Does google give more preference to websites with more number of pages than those with lesser number of pages to display results in SERP (I have just 50 pages). Does the NUMBER of pages really matter ? 3. Does removal / change of URLs have any negative effect on ranking ? (Many of these URLs were not shown on the 1st page) An answer from SEO experts will be highly appreciated. Thnx !

                            Intermediate & Advanced SEO | Dec 24, 2012, 9:27 AM | PepMozBot
                            0
                          • TauriU

                            Google is indexing wordpress attachment pages

                            Hey, I have a bit of a problem/issue what is freaking me out a bit. I hope you can help me. If i do site:www.somesitename.com search in Google i see that Google is indexing my attachment pages. I want to redirect attachment URL's to parent post and stop google from indexing them. I have used different redirect plugins in hope that i can fix it myself but plugins don't work. I get a error:"too many redirects occurred trying to open www.somesitename.com/?attachment_id=1982 ". Do i need to change something in my attachment.php fail? Any idea what is causing this problem? get_header(); ?> /* Run the loop to output the attachment. * If you want to overload this in a child theme then include a file * called loop-attachment.php and that will be used instead. */ get_template_part( 'loop', 'attachment' ); ?>

                            Intermediate & Advanced SEO | May 14, 2013, 1:32 PM | TauriU
                            0
                          • CommercePundit

                            Number of Indexed Pages are Continuously Going Down

                            I am working on online retail stores. Initially, Google have indexed 10K+ pages of my website. I have checked number of indexed page before one week and pages were 8K+. Today, number of indexed pages are 7680. I can't understand why should it happen and How can fix it? I want to index maximum pages of my website.

                            Intermediate & Advanced SEO | Jan 2, 2012, 9:34 PM | CommercePundit
                            0

                          Get started with Moz Pro!

                          Unlock the power of advanced SEO tools and data-driven insights.

                          Start my free trial
                          Products
                          • Moz Pro
                          • Moz Local
                          • Moz API
                          • Moz Data
                          • STAT
                          • Product Updates
                          Moz Solutions
                          • SMB Solutions
                          • Agency Solutions
                          • Enterprise Solutions
                          Free SEO Tools
                          • Domain Authority Checker
                          • Link Explorer
                          • Keyword Explorer
                          • Competitive Research
                          • Brand Authority Checker
                          • Local Citation Checker
                          • MozBar Extension
                          • MozCast
                          Resources
                          • Blog
                          • SEO Learning Center
                          • Help Hub
                          • Beginner's Guide to SEO
                          • How-to Guides
                          • Moz Academy
                          • API Docs
                          About Moz
                          • About
                          • Team
                          • Careers
                          • Contact
                          Why Moz
                          • Case Studies
                          • Testimonials
                          Get Involved
                          • Become an Affiliate
                          • MozCon
                          • Webinars
                          • Practical Marketer Series
                          • MozPod
                          Connect with us

                          Contact the Help team

                          Join our newsletter
                          Moz logo
                          © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                          • Accessibility
                          • Terms of Use
                          • Privacy

                          Looks like your connection to Moz was lost, please wait while we try to reconnect.