No Index help
-
Hi, I have alot of notices about webpages that are apparently blocked by no index robots, I look through the code on the site and cannot see any coding for this and am confused how to fix the problem. Help anyone?
-
Thanks for your great help Sha!
-
Hi Steven,
There are two different robot related warnings in your SEOmoz PRO App report. The second one refers to pages or directories blocked by a disallow statement in a robots.txt file.
Next step is to check whether you have a robots.txt file in place for your site and if so, then check to see if there are files or directories disallowed in the file.
If the robots.txt file is not an issue, then the your best course of action is to email the SEOmoz Help team direct - help [at] seomoz.org. Give them the details of your campaign and explain the problem and they will take a look at it for you.
Hope that helps,
Sha
-
Thanks for you reply! I have looked at the meta tags and there is no meta noindex tag, this is where i am getting confused on how to make the page an indexed one? I would expect to see either of the meta tags you displayed earlier however they are not there? Thanks
-
Hi Steven,
This message refers to a meta tag which appears in the head statement for the page.
the code looks like this:
OR
This tag tells crawlers not to index the page (or to remove the page from the index if it already appears there) and to either follow or not follow links on the page.
In most cases I would use noindex, follow as this allows any link juice being passed to the page to flow on through the site. The meta noindex tag is the most reliable way to ensure that pages are not indexed since it occurs at the page level. Other methods such as disallowing pages in a robots.txt file can be unreliable as crawlers that come to a page via an external link do not see the disallow statement, so will index the page.
The noindex tags on your pages may have been placed in order to exclude pages that were producing errors or are duplicates of other pages.
Hope that helps,
Sha
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Fixing Index Errors in the new Google Search Console - Help
Hi, So I have started using the new Search Console and for one of my clients, there are a few 'Index Coverage Errors'. In the old version you could simply, analyse, test and then mark any URLs as fixed - does anyone know if that is possible in the new version? There are options to validate errors but no 'mark as fixed' options. Do you need to validate the errors before you can fix them?
On-Page Optimization | | daniel-brooks0 -
Is this helping?
A few months ago, in hopes of a) helping new customers navigate the sometimes-arcane language used in the precious metals industry and b) earning some props from Google for making the site more user friendly, I talked the Powers-That-Be into allowing me to create a glossary with links from some unfamiliar terms in each product description and added appropriate <title>tages for each term.</p> <p>My question is: <strong>In the opinion of SEOMoz was this endeavor a brilliant, transformative SEO brainstorm—or just a waste of my time?</strong></p> <p>We haven't been running analytics, so we are flying blind.</p> <p>Here's the 411:<br /> <br />Website: www.goldmart.com<br />Glossary: www.goldmart.com/glossary</p> <p>A sample description: http://www.goldmart.com/1-oz-pamp-suisse-lunar-snake-gold-bar-9999-fine-in-assay.html</p></title>
On-Page Optimization | | RScime250 -
Too Many On-Page Links, Can You HELP???
This is the best architecture I found to help my visitors find there furnace filter size. Does it hurt my SEO? Index page has, 210 links and most other pages has, 190 links. Thank you, BigBlaze
On-Page Optimization | | BigBlaze2050 -
Google cached snapshots and last indexed
My question is I noticed today that the snap shots of my main pages were outdated. About a month. Then I clicked on the "Learn More" link about cahced images and Google says "Google crawls the web and takes snapshots of each page. When you click Cached, you'll see the webpage as it looked when we last indexed it." I know this sounds really dumb, but does that really mean the last time Google indexed that page? So the changes I have made since then have not been taken yet?
On-Page Optimization | | cbielich0 -
Canonical Help?
This canonical thing is brand new to me and I'm trying to wrap my mind around it. Here is my situation: I use Wordpress. I am showing duplicate content with the following url's http://crosstrainingandfitness.com/online-workout-blog/ http://crosstrainingandfitness.com/online-workout-blog/page/2/ Would setting a canonical link solve this? If so, what do I put in the Canonical box for this category (online workout blog). I use Yoast's Wordpress SEO plugin. Any help is greatly appreciated.
On-Page Optimization | | carbbon0 -
Help with Appropriate Use of Rel Canonical
Whenever i enable Canonical URL through the 3DCart Control panel I get this Critical Factor error when running the on page report card: Appropriate Use of Rel Canonical Moderate fix <dl> <dt>Canonical URL</dt> <dd>"http://rcnitroshop.com/Nitro-Monster-Truck"</dd> <dt>Explanation</dt> <dd>If the canonical tag is pointing to a different URL, engines will not count this page as the reference resource and thus, it won't have an opportunity to rank. Make sure you're targeting the right page (if this isn't it, you can reset the target above) and then change the canonical tag to reference that URL.</dd> <dt>Recommendation</dt> <dd>We check to make sure that IF you use canonical URL tags, it points to the right page. If the canonical tag points to a different URL, engines will not count this page as the reference resource and thus, it won't have an opportunity to rank. If you've not made this page the rel=canonical target, change the reference to this URL. NOTE: For pages not employing canonical URL tags, this factor does not apply.</dd> </dl> Now if I disable Canonical URL then run the on page report card again the critical error goes away but I get this Optional Factor error instead: Canonical URL Tag Usage Moderate fix <dl> <dt>Number of Canonical tags</dt> <dd>0</dd> <dt>Explanation</dt> <dd>Although the canonical URL tag is generally thought of as a way to solve duplicate content problems, it can be extremely wise to use it on every (unique) page of a site to help prevent any query strings, session IDs, scraped versions, licensing deals or future developments to potentially create a secondary version and pull link juice or other metrics away from the original. We believe the canonical URL tag is a best practice to help prevent future problems, even if nothing is specifically duplicate/problematic today.</dd> <dt>Recommendation</dt> <dd>Add a canonical URL tag referencing this URL to the header of the page.</dd> </dl> So basically I disabled it because obviously a Critical error is much worse then an optional error. Is there a way I can get rid of both errors?
On-Page Optimization | | bilsonx0 -
Google indexing Internal Search Results
Greeting, Currently I have noticed that Google is starting to index our internal search page results. Should I block those pages in our robot txt file or have you ever heard of any websites that actually gained traffic or rank by letting Google index those pages? Thanks
On-Page Optimization | | Tonyd230 -
Sitemap Help!
Hi Guys, Quick question regarding sitemaps. I am currently working on a huge site that has masses of pages. I am looking to create a site map. How would you guys do this? i have looked at some tools but it say it will only do up to 30,000 pages roughly. It is so large it would be impossible to do this myself....any suggestions? Also, how do i find out how many pages my site actually has indexed and not indexed?? Thank You all Wayne
On-Page Optimization | | wazza19850