Meta Robots Tag - What's it really mean?
-
I used on a handful of pages recently and noticed that they're still popping up in the Google search index. I'd like to keep these from appearing, so I figured I needed a directive statement with stronger semantic meaning.
From what I understand, is what I'm looking for. Using this will keep Google from not only crawling the page, but indexing the page, as well.
I decided to see what the official robotstxt.org website said about it, so I checked (link here):
the NOFOLLOW directive only applies to links on this page. It's entirely likely that a robot might find the same links on some other page without a NOFOLLOW (perhaps on some other site), and so still arrives at your undesired page.
So, is their explanation saying that the page itself will be indexed, but the content / links on it won't be followed / indexed? Let me hear your thoughts, mozzers.
-
You can find out your desired meta robots setting by asking yourself two questions:
noindex or index: do you want this particular page to show up as a listing in the Google results for a query? Yes: index, No: noindex.
nofollow or follow: do you want the links on this page to be crawled (followed) by the search engine robots, thereby allowing them access to the deeper pages it links to (even though that particular page might even be noindexed). Yes: follow, No: nofollow
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Fire a tag when element is loaded on page (Google Tag Manager)
I'm using an Element Visibility trigger to track a value that appears on a page. However, I want to track this value even when the user doesn't scroll to the area of the page where the element is (i.e. when the page is loaded, and the value is displayed below the fold, but the user doesn't scroll down there). Is there a way of doing this
Reporting & Analytics | | RWesley0 -
Enable Ecommerce Tracking with Google Tag Manager
Hello all, I am having an issue with tracking the sales on a webshop, and I would like to know how I can enable the ecommerce tracking with Google Tag Manager? Right now I am tracking the pageviews fine, firing a Universal Analytics tag. How can I achieve this? Thank you.
Reporting & Analytics | | renehansen0 -
No Index Meta
Good Morning, So the company who redesigned our website forgot to take off any of the no-index stuff that was put onto the site once it went live. I removed everything in the robots.txt and the privacy settings in wordpress but I am still seeing Any suggestions on changing this or if its even necessary to change would be great! Thank you
Reporting & Analytics | | HashtagHustler0 -
Homepage disappeared from Google's index
The Title says it all..I just discovered that the Homepage is not in Google's index anymore. Homepage rankings have plummeted, our top keywords are nowhere to be found but most of keywords from deeper pages have dropped just one or two places. We just change the website design and some content but I strongly believe this is definitely something else due to the fact that it all happened so fast! There is one thing that I have to mention that might have been caused all this..our email client (Outlook) is using a lot of resources from our server and for the last couple of days the website was down quite a lot.
Reporting & Analytics | | echo1
There are some crawling errors in GWT but the homepage has been crawled because is not there, no other messages. Where should I look for?0 -
301 Redirect 'https'? First post - Newbie.
Good afternoon, Thank you in advance for your help - this is my first post and I am new to all of this. Situation: I've setup 301 redirects for www.thechiplab.com to my new site www.chiplab.com (recently launched e-commerce site on Magento) through cPanel. Problem: Some of my best links are to my old ''https:" www.thechiplab.com secure domain (ex. http://techcrunch.com/2006/12/22/why-doesnt-cafepress-use-flash/) and are not being "passed" on to the new domain. (Open Site Explorer) Is it possible to recover any of the PR from the old secure site? Thanks again, Chase
Reporting & Analytics | | chiplab0 -
Meta missing description tag ??
Hi everyone I am new to this site and I receive the above message which states, "Meta missing description tag" can anyone explain what this means, Otherwise I will contact someone tomorrow.
Reporting & Analytics | | IamPowerful0 -
Why Webmasters Tools verification meta tags change??
Why do these keep changing for sites that I have verfied over and over and over and over? About a month goes by and the meta code has changed and the site is unverified again. Seems like a trick to force you into logging into Webmaster Tools all the time. What gives???
Reporting & Analytics | | 2CDevGroup0 -
Increase in 'Googlebot-Image' visits in analytics
Hi, I noticed a substantial increase in 'Googlebot-Image' visits data under Technology>Browser & OS in Google analytics for a few clients. Is this a bug? Are there any known fixes apart from just adding a filter to exclude the data? Regards Niladri
Reporting & Analytics | | neildomain0