undefined
Skip to content
Moz logo Menu open Menu close
  • Products
    • Moz Pro
    • Moz Pro Home
    • Moz Local
    • Moz Local Home
    • STAT
    • Moz API
    • Moz API Home
    • Compare SEO Products
    • Moz Data
  • Free SEO Tools
    • Domain Analysis
    • Keyword Explorer
    • Link Explorer
    • Competitive Research
    • MozBar
    • More Free SEO Tools
  • Learn SEO
    • Beginner's Guide to SEO
    • SEO Learning Center
    • Moz Academy
    • SEO Q&A
    • Webinars, Whitepapers, & Guides
  • Blog
  • Why Moz
    • Agency Solutions
    • Enterprise Solutions
    • Small Business Solutions
    • Case Studies
    • The Moz Story
    • New Releases
  • Log in
  • Log out
  • Products
    • Moz Pro

      Your all-in-one suite of SEO essentials.

    • Moz Local

      Raise your local SEO visibility with complete local SEO management.

    • STAT

      SERP tracking and analytics for enterprise SEO experts.

    • Moz API

      Power your SEO with our index of over 44 trillion links.

    • Compare SEO Products

      See which Moz SEO solution best meets your business needs.

    • Moz Data

      Power your SEO strategy & AI models with custom data solutions.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Free SEO Tools
    • Domain Analysis

      Get top competitive SEO metrics like DA, top pages and more.

    • Keyword Explorer

      Find traffic-driving keywords with our 1.25 billion+ keyword index.

    • Link Explorer

      Explore over 40 trillion links for powerful backlink data.

    • Competitive Research

      Uncover valuable insights on your organic search competitors.

    • MozBar

      See top SEO metrics for free as you browse the web.

    • More Free SEO Tools

      Explore all the free SEO tools Moz has to offer.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Learn SEO
    • Beginner's Guide to SEO

      The #1 most popular introduction to SEO, trusted by millions.

    • SEO Learning Center

      Broaden your knowledge with SEO resources for all skill levels.

    • On-Demand Webinars

      Learn modern SEO best practices from industry experts.

    • How-To Guides

      Step-by-step guides to search success from the authority on SEO.

    • Moz Academy

      Upskill and get certified with on-demand courses & certifications.

    • MozCon

      Save on Early Bird tickets and join us in London or New York City

    Unlock flexible pricing & new endpoints
    Moz API

    Unlock flexible pricing & new endpoints

    Find your plan
  • Blog
  • Why Moz
    • Small Business Solutions

      Uncover insights to make smarter marketing decisions in less time.

    • Agency Solutions

      Earn & keep valuable clients with unparalleled data & insights.

    • Enterprise Solutions

      Gain a competitive edge in the ever-changing world of search.

    • The Moz Story

      Moz was the first & remains the most trusted SEO company.

    • Case Studies

      Explore how Moz drives ROI with a proven track record of success.

    • New Releases

      Get the scoop on the latest and greatest from Moz.

    Surface actionable competitive intel
    New Feature

    Surface actionable competitive intel

    Learn More
  • Log in
    • Moz Pro
    • Moz Local
    • Moz Local Dashboard
    • Moz API
    • Moz API Dashboard
    • Moz Academy
  • Avatar
    • Moz Home
    • Notifications
    • Account & Billing
    • Manage Users
    • Community Profile
    • My Q&A
    • My Videos
    • Log Out

The Moz Q&A Forum

  • Forum
  • Questions
  • Users
  • Ask the Community

Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

  1. Home
  2. SEO Tactics
  3. Intermediate & Advanced SEO
  4. Using 2 wildcards in the robots.txt file

Moz Q&A is closed.

After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

Using 2 wildcards in the robots.txt file

Intermediate & Advanced SEO
2
2
1.0k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as question
Log in to reply
This topic has been deleted. Only users with question management privileges can see it.
  • seo123456
    seo123456 last edited by Jan 19, 2012, 5:40 PM

    I have a URL string which I don't want to be indexed. it includes the characters _Q1 ni the middle of the string.

    So in the robots.txt can I use 2 wildcards in the string to take out all of the URLs with that in it?  So something like /_Q1.  Will that pickup and block every  URL with those characters in the string?

    Also, this is not directly of the root, but in a secondary directory, so .com/.../_Q1.  So do I have to format the robots.txt as //_Q1* as it will be in the second folder or just using /_Q1 will pickup everything no matter what folder it is on?

    Thanks.

    1 Reply Last reply Reply Quote 0
    • lonniea
      lonniea last edited by Jan 20, 2012, 5:25 AM Jan 20, 2012, 5:25 AM

      I'm not 100% positive, however it does make sense to use it this way.

      User-agent: *
      Disallow: /*_Q1$

      1 Reply Last reply Reply Quote 0
      • 1 / 1
      1 out of 2
      • First post
        1/2
        Last post

      Got a burning SEO question?

      Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


      Start my free trial


      Browse Questions

      Explore more categories

      • Moz Tools

        Chat with the community about the Moz tools.

      • SEO Tactics

        Discuss the SEO process with fellow marketers

      • Community

        Discuss industry events, jobs, and news!

      • Digital Marketing

        Chat about tactics outside of SEO

      • Research & Trends

        Dive into research and trends in the search industry.

      • Support

        Connect on product support and feature requests.

      • See all categories

      Related Questions

      • india-morocco

        Move to new domain using Canonical Tag

        At the moment, I am moving from olddomain.com (niche site) to the newdomain.com (multi-niche site). Due to some reasons, I do not want to use 301 right now and planning to use the canonical pointing to the new domain instead. Would Google rank the new site instead of the old site? From what I have learnt, the canonical tag lets Google know that which is the main source of the contents. Thank you very much!

        Intermediate & Advanced SEO | Feb 19, 2019, 9:16 AM | india-morocco
        0
      • rayvensoft

        How to combine 2 pages (same domain) that rank for same keyword?

        Hi Mozzers, A quick question.  In the last few months I have noticed that for a number of keywords I am having 2 different pages on my domain show up in the SERP.  Always right next to each other (for example, position #7 and #8 or #3 and #4).  So in the SERP it looks something like: www.mycompetition1.com www.mycompetition2.com www.mywebsite.com/page1.html
        4) www.mywebsite.com**/page2.html**
        5) www.mycompetition3.com Now, I actually need both pages since the content on both pages is different - but on the same topic.  Both pages have links to them, but page1.html always tends to have more.  So, what is the best practice to tell Google that I only want 1 page to rank?  Of course, the idea is that by combining the SEO Juice of both pages, I can push my way up to position 2 or 1. Does anybody have any experience in this?  Any advice is much appreciated.

        Intermediate & Advanced SEO | Jul 10, 2014, 6:41 AM | rayvensoft
        0
      • dancape

        Using the same content on different TLD's

        HI Everyone, We have clients for whom we are going to work with in different countries but sometimes with the same  language. For example we might have a client in a competitive niche working in Germany, Austria and Switzerland (Swiss German) ie we're going to potentially rewrite our website three times in German, We're thinking of using Google's href lang tags and use pretty much the same content - is this a safe option, has anyone actually tries this successfully or otherwise? All answers appreciated. Cheers, Mel.

        Intermediate & Advanced SEO | Apr 16, 2014, 9:04 AM | dancape
        1
      • Branden_S

        Using pictures from another domain

        We are building several sites for several clients which will be using images from the manufacturer.  Our dev team wants to insert the manufacturer's url for the images, instead of actually downloading the image and hosting on our server.  There are thousands of images, so downloading images to our server will be time consuming, so we are looking for a shortcut.... however I'm concerned this will cause other issues. Is using manufactueresdomain.com/12345.jpg going to cause SEO issues?  will this generate Google penalties?  Since we are not able to control the image file name, we cannot optimize it.  We will add Alt text and Title tag for each image, but the file name is random characters.  How important is the file name for SEO?

        Intermediate & Advanced SEO | Apr 8, 2014, 1:17 PM | Branden_S
        0
      • jasondexter

        How to track mentions with links using Mentions App

        We have a large client that we've just taken on board for organic search marketing. A great client that continually gets links from the BBC, NY Times etc which actually takes care of having to do any marketing for them. However, they get 10-15 unlinked mentions per day. Just recently, they peaked at 32 mentions in one day from JUST websites. But I need a quick way to filter these out and check if there is a link pointing to their website. I want to be able to build up a list of opportunities without having to manually check each website. How do, Mozzlars!?

        Intermediate & Advanced SEO | Jan 16, 2014, 1:33 PM | jasondexter
        0
      • BeytzNet

        Is there a limit to images file names?

        Hi, I have an eCommerce site with hundreds of product images. For management reasons files are named in length to have the product details in them.
        Is there a limit for a filename length before it is considered ambiguous or spammy etc.?
        (it usually ranges 50-70 chars). Thanks

        Intermediate & Advanced SEO | Dec 2, 2013, 8:05 PM | BeytzNet
        0
      • Allie_Williams

        When to Use Schema vs. Facebook Open Graph?

        I have a client who for regulatory reasons cannot engage in any social media: no Twitter, Facebook, or Google+ accounts. No social sharing buttons allowed on the site. The industry is medical devices. We are in the process of redesigning their site, and would like to include structured markup wherever possible. For example, there are lots of schema types under MedicalEntity: http://schema.org/MedicalEntity Given their lack of social media (and no plans to ever use it), does it make sense to incorporate OG tags at all? Or should we stick exclusively to the schemas documented on schema.org?

        Intermediate & Advanced SEO | Oct 24, 2013, 1:12 PM | Allie_Williams
        0
      • Sayers

        How do you implement dynamic SEO-friendly URLs using Ajax without using hashbangs?

        We're building a new website platform and are using Ajax as the method for allowing users to select from filters. We want to dynamically insert elements into the URL as the filters are selected so that search engines will index multiple combinations of filters. We're struggling to see how this is possible using symfony framework. We've used www.gizmodo.com as an example of how to achieve SEO and user-friendly URLs but this is only an example of achieving this for static content. We would prefer to go down a route that didn't involve hashbangs if possible. Does anyone have any experience using hashbangs and how it affected their site? Any advice on the above would be gratefully received.

        Intermediate & Advanced SEO | Aug 24, 2011, 12:19 PM | Sayers
        1

      Get started with Moz Pro!

      Unlock the power of advanced SEO tools and data-driven insights.

      Start my free trial
      Products
      • Moz Pro
      • Moz Local
      • Moz API
      • Moz Data
      • STAT
      • Product Updates
      Moz Solutions
      • SMB Solutions
      • Agency Solutions
      • Enterprise Solutions
      Free SEO Tools
      • Domain Authority Checker
      • Link Explorer
      • Keyword Explorer
      • Competitive Research
      • Brand Authority Checker
      • Local Citation Checker
      • MozBar Extension
      • MozCast
      Resources
      • Blog
      • SEO Learning Center
      • Help Hub
      • Beginner's Guide to SEO
      • How-to Guides
      • Moz Academy
      • API Docs
      About Moz
      • About
      • Team
      • Careers
      • Contact
      Why Moz
      • Case Studies
      • Testimonials
      Get Involved
      • Become an Affiliate
      • MozCon
      • Webinars
      • Practical Marketer Series
      • MozPod
      Connect with us

      Contact the Help team

      Join our newsletter
      Moz logo
      © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
      • Accessibility
      • Terms of Use
      • Privacy

      Looks like your connection to Moz was lost, please wait while we try to reconnect.