undefined
Skip to content
Moz logo Menu open Menu close
  • Products
    • Moz Pro
    • Moz Pro Home
    • Moz Local
    • Moz Local Home
    • STAT
    • Moz API
    • Moz API Home
    • Compare SEO Products
    • Moz Data
  • Free SEO Tools
    • Domain Analysis
    • Keyword Explorer
    • Link Explorer
    • Competitive Research
    • MozBar
    • More Free SEO Tools
  • Learn SEO
    • Beginner's Guide to SEO
    • SEO Learning Center
    • Moz Academy
    • SEO Q&A
    • Webinars, Whitepapers, & Guides
  • Blog
  • Why Moz
    • Agency Solutions
    • Enterprise Solutions
    • Small Business Solutions
    • Case Studies
    • The Moz Story
    • New Releases
  • Log in
  • Log out
  • Products
    • Moz Pro

      Your all-in-one suite of SEO essentials.

    • Moz Local

      Raise your local SEO visibility with complete local SEO management.

    • STAT

      SERP tracking and analytics for enterprise SEO experts.

    • Moz API

      Power your SEO with our index of over 44 trillion links.

    • Compare SEO Products

      See which Moz SEO solution best meets your business needs.

    • Moz Data

      Power your SEO strategy & AI models with custom data solutions.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Free SEO Tools
    • Domain Analysis

      Get top competitive SEO metrics like DA, top pages and more.

    • Keyword Explorer

      Find traffic-driving keywords with our 1.25 billion+ keyword index.

    • Link Explorer

      Explore over 40 trillion links for powerful backlink data.

    • Competitive Research

      Uncover valuable insights on your organic search competitors.

    • MozBar

      See top SEO metrics for free as you browse the web.

    • More Free SEO Tools

      Explore all the free SEO tools Moz has to offer.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Learn SEO
    • Beginner's Guide to SEO

      The #1 most popular introduction to SEO, trusted by millions.

    • SEO Learning Center

      Broaden your knowledge with SEO resources for all skill levels.

    • On-Demand Webinars

      Learn modern SEO best practices from industry experts.

    • How-To Guides

      Step-by-step guides to search success from the authority on SEO.

    • Moz Academy

      Upskill and get certified with on-demand courses & certifications.

    • MozCon

      Save on Early Bird tickets and join us in London or New York City

    Unlock flexible pricing & new endpoints
    Moz API

    Unlock flexible pricing & new endpoints

    Find your plan
  • Blog
  • Why Moz
    • Small Business Solutions

      Uncover insights to make smarter marketing decisions in less time.

    • Agency Solutions

      Earn & keep valuable clients with unparalleled data & insights.

    • Enterprise Solutions

      Gain a competitive edge in the ever-changing world of search.

    • The Moz Story

      Moz was the first & remains the most trusted SEO company.

    • Case Studies

      Explore how Moz drives ROI with a proven track record of success.

    • New Releases

      Get the scoop on the latest and greatest from Moz.

    Surface actionable competitive intel
    New Feature

    Surface actionable competitive intel

    Learn More
  • Log in
    • Moz Pro
    • Moz Local
    • Moz Local Dashboard
    • Moz API
    • Moz API Dashboard
    • Moz Academy
  • Avatar
    • Moz Home
    • Notifications
    • Account & Billing
    • Manage Users
    • Community Profile
    • My Q&A
    • My Videos
    • Log Out

The Moz Q&A Forum

  • Forum
  • Questions
  • Users
  • Ask the Community

Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

  1. Home
  2. SEO Tactics
  3. Technical SEO
  4. Best way to noindex long dynamic urls?

Moz Q&A is closed.

After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

Best way to noindex long dynamic urls?

Technical SEO
3
12
2.9k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as question
Log in to reply
This topic has been deleted. Only users with question management privileges can see it.
  • wcbuckner
    wcbuckner last edited by Jan 28, 2014, 9:51 PM

    I just got a Mozcrawl back and see lots of errors for overly dynamic urls. The site is a villa rental site that gives users the ability to search by bedroom, amenities, price, etc, so I'm wondering what the best way to keep these types of dynamically generated pages with urls like /property-search-page/?location=any&status=any&type=any&bedrooms=9&bathrooms=any&min-price=any&max-price=any from indexing.

    Any assistance will be greatly appreciated : )

    1 Reply Last reply Reply Quote 0
    • FedeEinhorn
      FedeEinhorn @wcbuckner last edited by Jan 29, 2014, 2:46 PM Jan 29, 2014, 2:46 PM

      If you have a page that lists all the villas outside the search results, then you don't lose anything by blocking that folder on the robots.txt

      But still, somebody, the guy that wrote the custom theme knows how to do the changes needed.

      If you want I can help you with it, for free 🙂 Just PM me (I'll need FTP access).

      1 Reply Last reply Reply Quote 0
      • wcbuckner
        wcbuckner @FedeEinhorn last edited by Jan 29, 2014, 12:49 PM Jan 29, 2014, 12:49 PM

        Having some trouble... Because the site is Wordpress, which dynamically generates pages, there is no /property-search-page/ nor is there a property-search-page.php in the editor files, so the only option I have is to put disallow: /property-search-page/ in the robots.txt file, correct?

        FedeEinhorn 1 Reply Last reply Jan 29, 2014, 2:46 PM Reply Quote 0
        • wcbuckner
          wcbuckner @FedeEinhorn last edited by Jan 29, 2014, 3:15 AM Jan 29, 2014, 3:15 AM

          You guys rock! I'll try these out tomorrow. Thanks a million.

          1 Reply Last reply Reply Quote 0
          • FedeEinhorn
            FedeEinhorn @wcbuckner last edited by Jan 29, 2014, 2:02 AM Jan 29, 2014, 2:02 AM

            If you have a /all-villas/ page then you should go ahead and noindex the search results as Google Guidelines suggests. You can either do it in the /property-search-page/ or using the robots.txt file.

            In the robots.txt, add:

            disallow: /property-search-page/

            The robots method guarantees that no page inside that folder is indexed or even crawled (including /property-search-page/?whatever).

            Or on the page /property-search-page/ you can add the meta noindex as such:

            Then check if that meta tag is shown in all search results (just check a couple of them).

            Hope that works!

            wcbuckner 2 Replies Last reply Jan 29, 2014, 12:49 PM Reply Quote 0
            • NakulGoyal
              NakulGoyal @wcbuckner last edited by Jan 29, 2014, 1:58 AM Jan 29, 2014, 1:58 AM

              Yes, it will. Also looks like custom code, it depends on how the header is coded. But it should work. Test it, if you can. This should solve your problems relatively easily. If nothing works, you can always do a robots.txt deny for /property-search-page/?* pages, but that's not a recommended solution. Try the canonical way to see if it works first.

              1 Reply Last reply Reply Quote 0
              • wcbuckner
                wcbuckner @FedeEinhorn last edited by Jan 29, 2014, 1:52 AM Jan 29, 2014, 1:52 AM

                We already have Yoast installed, but the errors are still showing up in the Moz report.

                To clarify, let's assume we have another page that lists all the villas (/all-villas/). If I go to the property-search-page php file and canonical=rel it to /all-villas/, will it canonical=rel all /property-search-page/?whatever pages to the /all-villas/ page?

                NakulGoyal FedeEinhorn 2 Replies Last reply Jan 29, 2014, 2:02 AM Reply Quote 0
                • FedeEinhorn
                  FedeEinhorn @wcbuckner last edited by Jan 29, 2014, 1:40 AM Jan 29, 2014, 1:40 AM

                  Well, that will make a little easier from one side and harder from the other.

                  You can try installing SEO by Yoast, that will put all the canonical tags for you, however, I think it won't link the search result pages to the canonical page that lists them all.

                  That might require a little coding.

                  If there's another page, outside /property-search-page/ folder that lists all villas, then you can disallow that folder in the robots.txt file, and that should fix it. If there isn't, well, then you will need to edit the /property-search-page/ page to use a static canonical tag that points to the page that lists all the villas removing any kind of filtering.

                  Hope that helps!

                  wcbuckner 1 Reply Last reply Jan 29, 2014, 1:52 AM Reply Quote 0
                  • wcbuckner
                    wcbuckner @NakulGoyal last edited by Jan 29, 2014, 1:34 AM Jan 29, 2014, 1:34 AM

                    Thanks for the response. The site is Wordpress - is there an easy way to write some sort of rule that would canonical any of these types of pages to a category page? How would you go about doing that?

                    1 Reply Last reply Reply Quote 0
                    • wcbuckner
                      wcbuckner @FedeEinhorn last edited by Jan 29, 2014, 1:33 AM Jan 29, 2014, 1:33 AM

                      Thanks for the response. The site is Wordpress - is there an easy way to write some sort of rule that would canonical any of these types of pages to a category page? How would you go about doing that?

                      FedeEinhorn 1 Reply Last reply Jan 29, 2014, 1:40 AM Reply Quote 0
                      • NakulGoyal
                        NakulGoyal last edited by Jan 29, 2014, 12:49 AM Jan 29, 2014, 12:49 AM

                        I agree with Federico one hundred percent. Figure out what your primary SEO friendly URLs are for these kinds of pages and canonical them back to that page.

                        wcbuckner 1 Reply Last reply Jan 29, 2014, 1:34 AM Reply Quote 0
                        • FedeEinhorn
                          FedeEinhorn last edited by Jan 28, 2014, 9:57 PM Jan 28, 2014, 9:57 PM

                          I wouldn't put a noindex meta on them, instead I would consider using a canonical tag pointing to the page that lists all the villas.

                          Anyway, what programming language are you using?

                          wcbuckner 1 Reply Last reply Jan 29, 2014, 1:33 AM Reply Quote 1
                          • 1 / 1
                          1 out of 12
                          • First post
                            1/12
                            Last post

                          Got a burning SEO question?

                          Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


                          Start my free trial


                          Browse Questions

                          Explore more categories

                          • Moz Tools

                            Chat with the community about the Moz tools.

                          • SEO Tactics

                            Discuss the SEO process with fellow marketers

                          • Community

                            Discuss industry events, jobs, and news!

                          • Digital Marketing

                            Chat about tactics outside of SEO

                          • Research & Trends

                            Dive into research and trends in the search industry.

                          • Support

                            Connect on product support and feature requests.

                          • See all categories

                          Related Questions

                          • lfrazer123

                            Folders in url structure?

                            Hello, Revamping an out-of-date website and am wondering if I need to include the folders (categories) in the url structure? The proposed structure has 8 main folders. I've been reading that Google is ok if the folder is not included in the url, but is it really? The hesitation I have is that the urls are getting long and the main folder only has only a sub folder beneath it. So, /folder-name/facility-name/treatment-overview. This looks too long, doesn't it? Thanks!

                            Technical SEO | Oct 26, 2018, 10:03 AM | lfrazer123
                            0
                          • dkellyagile

                            Topic Cluster: URL Best Practices

                            I'm trying to be mature and employ the Topic Cluster strategy to my content. In doing so I realized there are a few URL options. Some more difficult to execute than others. -Is it important to call out the Pillar Topic in your subtopic URL?
                            -Does the Pillar Topic need to have its own landing page? (As opposed to just being part of the blog.) Here's an Example: My Pillar is: Inbound vs. Outbound
                            My subtopic is: Marketing Platforms Here are the URL options I can think of... Option 1: https://pipelineinbound.com/blog/inbound-vs-outbound-marketing-platforms/ Option 2: https://pipelineinbound.com/blog/which-marketing-platforms/ Option 3: https://pipelineinbound.com/blog/marketing-platforms-inbound-vs-outbound/ Option 4 (Hardest): https://pipelineinbound.com/inbound-vs-outbound/marketing-platforms/ Are there some fundamental best practices for URL structure and Link Building as it pertains to Topic Clusters? Thanks!

                            Technical SEO | Apr 11, 2018, 10:25 AM | dkellyagile
                            0
                          • Kilgray

                            Best practice for URL - Language/country

                            Hi, We are planning on having our website localized into more languages. We already have an English and German version. The German version is currently a sub-domain: www.example.com --> English version de.example.com --> German version Is this recommended? Or is it always better to have URLs with language prefixes such a: www.example.com/de www.example.com/es Which is a better practice in terms of SEO?

                            Technical SEO | Oct 21, 2015, 10:34 AM | Kilgray
                            1
                          • pkontopoulos

                            What is the best way to refresh a webpage of a news site, SEO wise?

                            Hello all, we have a client which is a sports website. In fact it is a veyr big website and has a huge number of news per day. This is mostly the reason why it refreshes some of its pages with news list every 420 seconds. We currently use meta refresh. I have read here and elsewhere that meta refreshes should be avoided. But we don't do it to send to another page and pass any kind of page authority / juice. Is in this case javascript refresh better? Is there any other better way. What do you think & suggest? Thank you!

                            Technical SEO | Jan 27, 2014, 7:18 AM | pkontopoulos
                            0
                          • categorycode

                            What is the best way to deal with an event calendar

                            I have an event calendar that has multiple repeating items into the future. They are classes that typically all have the same titles but will occasionally have different information. I don't know what is the best way to deal with them and am open to suggestions. Currently Moz anayltics is showing multiple errors (duplicate page titles, descriptions and overly dynamic urls). I'm assuming that it's showing duplicate elements way into the future. I thought of having the calendar no followed at all but the content for the classes seems valuable. Thanks,

                            Technical SEO | Dec 26, 2013, 6:57 PM | categorycode
                            0
                          • markgreggs

                            How to change noindex to index?

                            Hey, I've recently upgraded to a pro SEOmoz account and have realised i have 14574 issues to do with 'blocked by meta-robot' and that 'This page is being kept out of the search engine indexes by the meta tag , which may have a value of "noindex", keeping this page out of the index.' How can i change this so my pages get indexed? I read somewhere that i need to change my privacy settings but that thread was 3 years old and now the WP Dashboard has updated.. Please let me know Many thanks, Jamie P.s Im using WordPress 3.5 And i have the XML sitemap plugin And i have no idea where to look for this robots.txt file..

                            Technical SEO | Jan 14, 2013, 3:56 PM | markgreggs
                            0
                          • RocketZando

                            Best Way To Clean Up Unruly SubDomain?

                            Hi, I have several subdomains that present no real SEO value, but are being indexed. They don't earn any backlinks either. What's the best way of cleaning them up? I was thinking the following: 1. Verify them all in Webmaster Tools. 2. Remove all URLs from the index via the Removal Tool in WMT 3. Add site-wide no-index, follow directive. Also, to remove the URLs in WMT, you usually have to block the URLs via /robots.txt. If I'd like to keep Google crawling through the subdomains and remove their URLs, is there a way to do so?

                            Technical SEO | Dec 31, 2012, 11:11 AM | RocketZando
                            0
                          • anjonr

                            What is the best way to find stranded pages?

                            I have a client that has a site that has had a number of people in charge of it. All of these people have very different opinions about what should be on the site itself. When I look at their website on the server I see pages that do not have any obvious navigation to them. What is the best way to find out the internal linking structure of a site and see if these pages truly are stranded?

                            Technical SEO | May 11, 2012, 5:23 AM | anjonr
                            0

                          Get started with Moz Pro!

                          Unlock the power of advanced SEO tools and data-driven insights.

                          Start my free trial
                          Products
                          • Moz Pro
                          • Moz Local
                          • Moz API
                          • Moz Data
                          • STAT
                          • Product Updates
                          Moz Solutions
                          • SMB Solutions
                          • Agency Solutions
                          • Enterprise Solutions
                          Free SEO Tools
                          • Domain Authority Checker
                          • Link Explorer
                          • Keyword Explorer
                          • Competitive Research
                          • Brand Authority Checker
                          • Local Citation Checker
                          • MozBar Extension
                          • MozCast
                          Resources
                          • Blog
                          • SEO Learning Center
                          • Help Hub
                          • Beginner's Guide to SEO
                          • How-to Guides
                          • Moz Academy
                          • API Docs
                          About Moz
                          • About
                          • Team
                          • Careers
                          • Contact
                          Why Moz
                          • Case Studies
                          • Testimonials
                          Get Involved
                          • Become an Affiliate
                          • MozCon
                          • Webinars
                          • Practical Marketer Series
                          • MozPod
                          Connect with us

                          Contact the Help team

                          Join our newsletter
                          Moz logo
                          © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                          • Accessibility
                          • Terms of Use
                          • Privacy

                          Looks like your connection to Moz was lost, please wait while we try to reconnect.