No Index help
-
Hi, I have alot of notices about webpages that are apparently blocked by no index robots, I look through the code on the site and cannot see any coding for this and am confused how to fix the problem. Help anyone?
-
Thanks for your great help Sha!
-
Hi Steven,
There are two different robot related warnings in your SEOmoz PRO App report. The second one refers to pages or directories blocked by a disallow statement in a robots.txt file.
Next step is to check whether you have a robots.txt file in place for your site and if so, then check to see if there are files or directories disallowed in the file.
If the robots.txt file is not an issue, then the your best course of action is to email the SEOmoz Help team direct - help [at] seomoz.org. Give them the details of your campaign and explain the problem and they will take a look at it for you.
Hope that helps,
Sha
-
Thanks for you reply! I have looked at the meta tags and there is no meta noindex tag, this is where i am getting confused on how to make the page an indexed one? I would expect to see either of the meta tags you displayed earlier however they are not there? Thanks
-
Hi Steven,
This message refers to a meta tag which appears in the head statement for the page.
the code looks like this:
OR
This tag tells crawlers not to index the page (or to remove the page from the index if it already appears there) and to either follow or not follow links on the page.
In most cases I would use noindex, follow as this allows any link juice being passed to the page to flow on through the site. The meta noindex tag is the most reliable way to ensure that pages are not indexed since it occurs at the page level. Other methods such as disallowing pages in a robots.txt file can be unreliable as crawlers that come to a page via an external link do not see the disallow statement, so will index the page.
The noindex tags on your pages may have been placed in order to exclude pages that were producing errors or are duplicates of other pages.
Hope that helps,
Sha
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How can I check spam score and non indexed links
Hi I am working on a project in which I have a local services website <a target="_self">www.thepcrrg.com</a> I want to be sure its links are getting indexed or not. Please help me.
On-Page Optimization | | Jioiebytt2 -
Index or No Index (Panda Issue)
Hi, I believe our website has been penalized by the panda update. We have over 9000 pages and we are currently indexing around 4,000 of those pages. I believe that more than half of the pages indexes have either thin content. Should we stop indexing those pages until we have quality page content? That will leave us with very few pages being indexed by Google (Roughly 1,000 of our 9,000 pages have quality content). I am worried that we would hurt our organic traffic more by not indexing the pages than by indexing the pages for google to read. Any help would be greatly appreciated. Thanks, Jim Rodriguez
On-Page Optimization | | dustyabe0 -
Index SEO Performance
Hi guys, I was wondering if there is a difference in SEO performance between a page which ends with .html or just with a slash. For example: www.domain.com/test/ - www.domain.com/test.html Which one is better? And is there a difference between productpages and productcategory pages. Because we see mostly productpages ending with .html and category pages ending with a slash. Take a look at some big dutch companies like: http://www.coolblue.nl/
On-Page Optimization | | Happy-SEO
http://www.bol.com/
https://www.zalando.nl/ (product page) There are doing this with a reason.... i guess.... Thanks.1 -
Rel Canonical help
Is it possible to confirm this to me please? My understanding of the rel canonical tag was to tell google of duplicate content? so for instance product 1
On-Page Optimization | | TeamacPaints
www.ourdomain.co.uk/products/category/subcategory/theproduct1 Product 1a
www.ourdomain.co.uk/products/category/subcategory/theproduct1a same content just a different colour would be rel canonical'd to Product 1 as thats the main product, is my understanding correct? Now here is what I have discovered. www.ourdomain.co.uk/products/category/subcategory/theproduct1 has a rel canonical tag that reverts back to www.ourdomain.co.uk/products/ which isn't optimized as such its just a generic catalog page. This is inccorect and google will dismiss the actial product and revert to the generic catalog page? any help would be great.0 -
Google Indexed = 35, 445 pages, Bing Indexed = 243 pages... Why?
Dear MozSquad, Can anyone check our site and let me know if there's anything super apparent that would cause Bing to treat us like a bum on the street? I recently made some structural changes which really helped with Google, but Bing didn't even budge. It's a lot harder to keep up with all the SEO initiatives I have in mind with it being a small start-up where I'm responsible for planning the entire Internet Marketing campaign, giving constant input on UX and site design, etc on top of 900 other things, so I figured it'd be a good time to use The Moz to help a brother out. Ideas? Domain: homeandgardendesignideas.com (yeah, I know it's a little long =P)
On-Page Optimization | | zDucketz0 -
Modifying Well Established & Well Indexed Content
I have a page that is very well indexed and has a 1st position ranking in google. It is the best landing page in my site. That being said, it's several years old and I honestly think it could be better. The images could be enlarged, the the images could have fancy box enlargements instead of just linking out to flickr, there could be more content about follow up projects that people have done. I'm noteably nervous about changing such a clutch piece of content on my site. I do want to improve the content for users, not just make it more SEO friendly (it's already SEO'd), but I'm afraid that any change could cause a set back in ranking. Am I being afraid of nothing, should I just go for it and improve my content, or should I be extra cautious when editing well indexed content like this? Thanks for the advice
On-Page Optimization | | CPollock0 -
How to properly remove pages and a category from Google's index
I want to remove this category http://www.webdesign.org/web-design-news-all/ and all the pages in that category (e.g. http://www.webdesign.org/web-design-news-all/7386.html ) from Google's index. I used the following string in the "Reomval URS" section in Google Webmaster Tools: http://www.webdesign.org/web-design-news-all/* is that correct or I better use http://www.webdesign.org/web-design-news-all/ ? Thanks in advance.
On-Page Optimization | | VinceWicks0 -
Why isn't Google indexing me?
Recently got handed off a .org site for a quasi state agency here in Michigan. Turns out the developer had the site live for the past six months but left the noindex, nofollow tag on everything so the site was invisible to search engines. Obviously we wiped all of those things a couple weeks ago when we got started, added all of our sitemaps to bing/yahoo/google webmaster tools and we've already started getting indexed by yahoo and bing and showing up for branded terms...but NOTHING from Google. WMT says our pages are all indexed, but we aren't showing up for anything in search and we don't seem to be indexed at all. Granted, if this site was brand new and didn't have any links I could see us taking a little time to get found, but this site has very good .gov and .edu links, plus we've built some other solid links to it since we've launched and Google continues to ignore it. I haven't seen this before, but could Google still be ignoring us from the months of noindex, nofollowing? If so, any tips on how to get back in teh Google's good graces here?
On-Page Optimization | | NetvantageMarketing0