Should Blog Category Archive URLs be Set to "No-Index" in Wordpress?
-
It appears that Google Webmaster Tools is listing about 120 blog archives URLs in Google Index>Index Status that should not be listed. Our site map contains 650 pages, but Google shows 860.
Pages like:
<colgroup><col width="464"></colgroup>
| http://www.nyc-officespace-leader.com/blog/category/manhattan-office-space |With Titles Like:
<colgroup><col width="454"></colgroup>
| Manhattan Office Space Archives - Metro Manhattan Office Space |Are listed when in the Rogerbot crawl report for the site.
How can we remove such pages from Google Webmaster Tools, Index Status? Our site map shows about 650 pages, yet Google show these extra pages. We would prefer that they not be indexed.
Note that these pages do not appear when we run a site:www.nyc-officespace-leader.com search.
The site has suffered a drop in ranking since May and we feel it prudent to keep Google from indexing useless URLs. Before May 650 pages showed on the Webmaster Tools Index status, and suddenly in early June when we upgraded the site the index grew by about 175 pages. I suspect the 120 blog archives URLs may have something to do with it. How can we get them removed?
Can we set them to "No-Index", or should the robot text be used to remove them? Or can some type of removal request be made to Google?
My developers have been struggling with this issue since early June. The bloat on the site is about 175 URLs not on the site map. Is there any go to authority on this issue (it is apparently rather complicated) that can provide a definitive answer?
Thanks!!
Alan -
Yup!
-
Hi Daniel:
You are correct other factors are probably contributing to the drop. The 175 extra URLs are a contributing factor. Our site contains 310 property listing pages of which 250 have a few sentences. It appears we were penalized by Panda 4.0 in May, which apparently targets thin content.
To reverse the penalty we intend to take the following steps:
-Set all listing pages with thin content pages to "No-Index, Follow"
-Somehow remove the 175 URLs that have magically appeared in June. Either set as "no-index, follow", "no-index, no-follow" canonicalize or somehow delete use robot text. My concern is that these 175 extra URLs could be construed as thin content and could be aggravating the Panda penalty.
-Enhance content on 30-40 critical pages.Does this seem reasonable?
Thanks, Alan
-
You wrote:
The site has suffered a drop in ranking since May and we feel it prudent to keep Google from indexing useless URLs. Before May 650 pages showed on the Webmaster Tools Index status, and suddenly in early June when we upgraded the site the index grew by about 175 pages. I suspect the 120 blog archives URLs may have something to do with it. How can we get them removed?
But is it possible this is an unwarranted conclusion? Perhaps you are heading down the wrong path in attempting removal.
Have you exhausted all other possibilities?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
App indexing with several subdomains
Hi, We are currently in the process of getting our app developed. From an SEO point of view I want the app to get indexed and am currently trying to get a step by step guide for it. I've come across this helpful guide: https://moz.com/blog/how-to-get-your-app-content-indexed-by-google but need to go a bit deeper now. Questions I have is related to the "apple-app-site-association" file As far as I could find out the JSON code of that file has the following syntax: {_ “applinks”: {__ “apps”: [],__ “details”: [__ {__ “appID”: “9JA89QQLNQ.com.my.bundle.id“,__ “paths”: [ “/myPath1”, “/myPath2/*” ]__ },__ ]__ }_ } My question is related to the key "appID" I'm wondering how the entry would look like if I have 10 country subdomains and would like to make sure that the deep link clicked in the browser is going to the right subdomain page within the app. Current website structure:
Web Design | | FashionLux
uk.example.com/english-path/
de.example.com/german-path/ Many Thanks in advance0 -
Will changing product from Grouped to Simple on my magento category page affect my SEO?
Hi all, A category page on my site http://www.porcelainsuperstore.co.uk/wood-effect.html currently ranks number 3 on Google for the keyword "Wood Effect Tiles" We're currently reorganising some of our product and I would like to know if this is going to affect the SEO and ranking for the above page and keyword. The majority of products on that page are magento grouped products. I would like to change the page so that it displays only the different constituent simple products rather than the grouped products on the category page. My question is, will this have any impact on SEO? I intend on leaving all other data on the category page the same - so the metadata and the description/title etc. Any help/comments would be much appreciated! Ben
Web Design | | piazza0 -
Hi, I have a doubt. If we want to hide unwanted text in a web page its possible with "" tag. And my question "does a search engine crawl those text? help me.
I want to hide a lot of text behind my site page. I know its possible with that tag. But in what way a search engine looks at those text? Hidden or they are crawled and indexed.
Web Design | | FhyzicsBCPL0 -
Existing URL structure and how to handle new pages before migration
Hi there! Currently, our site uses underscores "_" within the url structure. We are moving to Wordpress soon (the site is currently static html) but it will be a couple of months before the migration. Here is an example of the current structure: www.oldsitestructure.com/about_us/success_stories/custom_vinyl_banners When we do change, our url structure will have hyphen's "-" to separate terms, so the preferred new structure will be: www.oldsitestructure.com/about-us/success-stories/custom-vinyl-banners The entire site (with the exception of our Wordpress blog) currently uses the old structure. We have about 10 - 15 pages we will add before our migration, my question is: Should we use the preferred url structure starting NOW or stick with the old one? And set up 301 redirects are part of the migration process? Many thanks!
Web Design | | SEOSponge
Jon0 -
Duplicate Content? Designing new site, but all content got indexed on developer's sandbox
An ecommerce I'm helping is getting a complete redesign. Their developer had a sandbox version of their new site for design & testing. Several thousand products were loaded into the sandbox site. Then Google/Bing crawled and indexed the site (because developer didn't have a robots.txt), picking up and caching about 7,200 pages. There were even 2-3 orders placed on the sandbox site, so people were finding it. So what happens now?
Web Design | | trafficmotion
When the sandbox site is transferred to the final version on the proper domain, is there a duplicate content issue?
How can the developer fix this?0 -
Wordpress Blog Providing SEO to Main Site
Hi, I recently started a very much "learn on the job" SEO position, transitioning from a copywriting background. We currently have a wordpress blog up and running (and producing some decent quality content too I hope!) at example.com/blog/ and a sign up page located at example.com (sorry, can't put the address right now) for a site that is being custom built as it's got some nifty software linking to back end systems. My question is whether the content on the blog will bring SEO benefits to the main domain or whether it'll just be for the blog itself? If the latter, should we navigate the blog onto the a separate page of the main site? Thanks so much! I'm learning as much as I can as quickly as I can, but somethings still get me in a little bit of a tizzy.
Web Design | | LeahHutcheon0 -
Does anyone know how much a wordpress site can store (in terms of data) I want to put all my movies on it and use it as a personal global external hard drive! Thanks!!
So basically, I have about 500 GB of movies on my computer and I don't want to buy an external hardrive. I don't want to spend the money A website I could access anytime, and anywhere, without having to carry my external with me everywhere I go. Thanks in advance for any help/ references.
Web Design | | TylerAbernethy0 -
Is there a Consultant out there to help convert C#.net functions into PHP Wordpress functions?
We are going through a transition from SiteFinity (C# .net windows environment) to WordPress (PHP Linux environment). We currently have custom forms that make calls to webservices and also store data into SQL Server tables. Not sure how to do this in PHP and could use some help. We are located in Irvine, CA. We would prefer someone onsite, but can also work with someone remote if we must. Time is of the essence. Thanks.
Web Design | | balboafinance0