The Moz Q&A Forum

    • Forum
    • Questions
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Forum
    2. Categories
    3. SEO Tactics
    4. Technical SEO
    5. NoIndex/NoFollow pages showing up when doing a Google search using "Site:" parameter

    Moz Q&A is closed.

    After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

    NoIndex/NoFollow pages showing up when doing a Google search using "Site:" parameter

    Technical SEO
    5 3 4.9k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ChrisRoberts-MTI
      ChrisRoberts-MTI last edited by

      We recently launched a beta version of our new website in a subdomain of our existing site. The existing site is www.fonts.com with the beta living at new.fonts.com. We do not want Google to crawl the new site until it's out of beta so we have added the following on all pages:

      However, one of our team members noticed that google is displaying results from new.fonts.com when doing an "site:new.fonts.com" search (see attached screenshot). Is it possible that Google is indexing the content despite the noindex, nofollow tags? We have double checked the syntax and it seems correct except the trailing "/". I know Google still crawls noindexed pages, however, the fact that they're showing up in search results using the site search syntax is unsettling.

      Any thoughts would be appreciated!

      DyWRP.png

      1 Reply Last reply Reply Quote 0
      • ChrisRoberts-MTI
        ChrisRoberts-MTI @donford last edited by

        Thanks, appreciate you taking the time to write out a response!

        1 Reply Last reply Reply Quote 0
        • ChrisRoberts-MTI
          ChrisRoberts-MTI @My-Favourite-Holiday-Cottages last edited by

          Thank you for your reply. I will get this information over to the dev team!

          1 Reply Last reply Reply Quote 0
          • donford
            donford last edited by

            Hi Chris

            If Google sees a link to the page it may still list it in its index even though when they got there they saw the noindex tag so they didn't crawl it.

            The rational is they see a link from your main site with some anchor text and index the link based on the anchor text they can't crawl it because you say not to, but they still have some information about the page from your anchor text.

            Here is a direct Matt Cutts Quote:

            "Our highest duty has to be to our users, not to an individual webmaster. When a user does a navigational query and we don’t return the right link because of a NOINDEX tag, it hurts the user experience (plus it looks like a Google issue). If a webmaster really wants to be out of Google without even a single trace, they can use Google’s url removal tool."

            REF: http://www.mattcutts.com/blog/google-noindex-behavior/

            You can block access to the test site (which is what we do) via htacess (if you're on a Linux Server) and use the Google Index Removal Tool to strip out the currently indexed pages.

            I hope that helps.

            ChrisRoberts-MTI 1 Reply Last reply Reply Quote 1
            • My-Favourite-Holiday-Cottages
              My-Favourite-Holiday-Cottages last edited by

              If you have nofollow on all the pages, there is a chance it is being caused because google can't follow any links to your pages tho crawl and update them with the no-index tag.

              Try changing your links to noindex, follow.

              ChrisRoberts-MTI 1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post

              Got a burning SEO question?

              Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


              Start my free trial


              Explore more categories

              • Moz Tools

                Chat with the community about the Moz tools.

                Getting Started
                Moz Pro
                Moz Local
                Moz Bar
                API
                What's New

              • SEO Tactics

                Discuss the SEO process with fellow marketers

                Content Development
                Competitive Research
                Keyword Research
                Link Building
                On-Page Optimization
                Technical SEO
                Reporting & Analytics
                Intermediate & Advanced SEO
                Image & Video Optimization
                International SEO
                Local SEO

              • Community

                Discuss industry events, jobs, and news!

                Moz Blog
                Moz News
                Industry News
                Jobs and Opportunities
                SEO Learn Center
                Whiteboard Friday

              • Digital Marketing

                Chat about tactics outside of SEO

                Affiliate Marketing
                Branding
                Conversion Rate Optimization
                Web Design
                Paid Search Marketing
                Social Media

              • Research & Trends

                Dive into research and trends in the search industry.

                SERP Trends
                Search Behavior
                Algorithm Updates
                White Hat / Black Hat SEO
                Other SEO Tools

              • Support

                Connect on product support and feature requests.

                Product Support
                Feature Requests
                Participate in User Research

              • See all categories

              • Robots.txt & meta noindex--site still shows up on Google Search
                RoxBrock
                RoxBrock
                1
                8
                10.2k

              • How Does Google's "index" find the location of pages in the "page directory" to return?
                reidsteven75
                reidsteven75
                0
                9
                2.1k

              • How does Google find /feed/ at the end of all pages on my site?
                Vivamedia
                Vivamedia
                0
                10
                2.6k

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy

              Looks like your connection to Moz was lost, please wait while we try to reconnect.