Meta Robots Tag - What's it really mean?
-
I used on a handful of pages recently and noticed that they're still popping up in the Google search index. I'd like to keep these from appearing, so I figured I needed a directive statement with stronger semantic meaning.
From what I understand, is what I'm looking for. Using this will keep Google from not only crawling the page, but indexing the page, as well.
I decided to see what the official robotstxt.org website said about it, so I checked (link here):
the NOFOLLOW directive only applies to links on this page. It's entirely likely that a robot might find the same links on some other page without a NOFOLLOW (perhaps on some other site), and so still arrives at your undesired page.
So, is their explanation saying that the page itself will be indexed, but the content / links on it won't be followed / indexed? Let me hear your thoughts, mozzers.
-
You can find out your desired meta robots setting by asking yourself two questions:
noindex or index: do you want this particular page to show up as a listing in the Google results for a query? Yes: index, No: noindex.
nofollow or follow: do you want the links on this page to be crawled (followed) by the search engine robots, thereby allowing them access to the deeper pages it links to (even though that particular page might even be noindexed). Yes: follow, No: nofollow
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
If website users don't accept GDPR cookie consent, does that prevent GA-GTM from tracking pageviews and any traffic from that user that would cause significant traffic decreases?
I've been doing a lot research on GDPR impact and implementation with GTM-GA for clients, but it's been 12 months since GDPR has gone live I haven't found anything on how GA traffic has been impacted if users don't accept cookie consent. However, I'm personally seeing GA accounts taking huge losses in traffic since implementing GDPR cookie solutions (because GTM/GA tags aren't firing until cookies are accepted). Is it common for websites to see significant decreases in traffic due to too many users not accepting cookie consent? Are there alternative solutions to avoid traffic loss like that and still maintain GDPR compliance? It seems to me that the industry underestimated how many people won't accept cookie consent. Most of the documentation and articles around GDPR's start (May 2018) didn't foresee or cover that aspect properly, everything seems to be technically focused with the assumption that if implemented properly most people would accept cookie consent, but I'm personally not seeing that trend and it's destroying GA data (lost traffic, minimal source attribution, inaccurate behavior data, etc). Thanks.
Reporting & Analytics | | Kickboard2 -
Is the meta referrer tag still used
Is the meta meta referrer tag still used and is it affective. I have an issue with traffic going from one of my sites to a client site and our referral is going into their direct traffic (in Googel Analytics) instead of being seen as a referral from our site. I saw that people were using the meta referral tag, but I can't find any MOZ info about it other than a blog article from 2015.
Reporting & Analytics | | dpsoftware1 -
Google Optimize via Google Tag manager not working properly
Hi All, I am using google optimize via tag manager. I have successfully implemented it and my experiment appeared in google analytic but google optimize chrome addon always give me add script not installed properly. How to solve solve error? Thanks!
Reporting & Analytics | | amu1230 -
Two GTM tags
Hi guys, I need some help on the following: My client has different websites worldwide all with country extensions and on overall .com domain. These websites (and GTM accounts) are all managed by local agencies. We would like to implement a cross domain tracking GA account in order to see some overall trends and numbers. We don't want to implement our codes in the existing containers as they are in many cases managed by local agencies. Is it really negative to implement two GTM containers on one website? Any other ideas? Thanks,
Reporting & Analytics | | WeAreDigital_BE
Sander0 -
Does Installing Google Tag Manager Compromise Server Security?
Greetings MOZ community!!! Both my hosting company and developer have told me that in order to install Google Tag Manager it is necessary to disable the rule securing against malicious i-frame attacks in Mod Security and that this would leave the site (we operate on a virtual private server and out hosting company is InMotion Hosting) extremely vulnerable to attack. I can't believe that Google would write code that could allow potential security issues? Is this true? Does anyone know of a way to install GTM while maintaining site security? What functionality will we lose if we choose to stick with the old version of Google Analytics rather than upgrade? Thanks everyone!!!
Reporting & Analytics | | Kingalan1
Alan0 -
Whats 'Other' in Google Analytics (in Acquisition)
When i look in GA under Channels (under Acquisition) 'other' is listed What is 'other' ? I have been told its other unidentified channels as they did not allow 3rd party cookies or surfers were in anonymous/private mode. Other is usually organic traffic that couldn't be identified for the aformentioned reasons. This data is encrypted and available but it violates Google guidelines as they are not allowed to pass personal info//data to third parties so it is automatically filtered. But they are not 'Not Provided' (since that still shows under organic) but is usually/mainly some form of organic visits. Hence Seo can take credit for much of that traffic, is this correct ? Many Thanks
Reporting & Analytics | | Dan-Lawrence0 -
Can't seem to rank for keyword "home care grand rapids" - need some advice
I am trying to rank for "home care grand rapids" and am having a really difficult time. My site: http://healthcareassociates.net has better backlinks, keywords and other seo markers than my competitors but I still can't seem to rank. The keyword and associated keywords (home care grand rapids michigan, home health care grand rapids, etc.) are only 31-33% difficulty and my site/page rank is better than the leading sites. What gives? Todd
Reporting & Analytics | | t1kuslik0 -
Tracking 301'd Domains
'ello SEOMozers 🙂 I've been implementing some awesomely search engine friendly 301'd domains for clients and they work great but I seem to have missed the point where I track said domains in some fashion and come here to ask the question --> how are you all tracking refers from 301'd domains that are pointed to your main hubs? Currently our practice in-house is to alias them in our servers then use .htaccess rules to 301 them to the 1 domain to-rule-them-all but Google Analytics doesn't recognize them as different domains with that plan of action and there goes my refer tracking. Is there a super-star way to use the Google URL Builder and combine that with the above plan of action or a better plan? Has anyone else implemented something else more awesome-er that could help a girl out? Much thanks and Happy Thursday!
Reporting & Analytics | | treefrogseo0