Should Blog Category Archive URLs be Set to "No-Index" in Wordpress?
-
It appears that Google Webmaster Tools is listing about 120 blog archives URLs in Google Index>Index Status that should not be listed. Our site map contains 650 pages, but Google shows 860.
Pages like:
<colgroup><col width="464"></colgroup>
| http://www.nyc-officespace-leader.com/blog/category/manhattan-office-space |With Titles Like:
<colgroup><col width="454"></colgroup>
| Manhattan Office Space Archives - Metro Manhattan Office Space |Are listed when in the Rogerbot crawl report for the site.
How can we remove such pages from Google Webmaster Tools, Index Status? Our site map shows about 650 pages, yet Google show these extra pages. We would prefer that they not be indexed.
Note that these pages do not appear when we run a site:www.nyc-officespace-leader.com search.
The site has suffered a drop in ranking since May and we feel it prudent to keep Google from indexing useless URLs. Before May 650 pages showed on the Webmaster Tools Index status, and suddenly in early June when we upgraded the site the index grew by about 175 pages. I suspect the 120 blog archives URLs may have something to do with it. How can we get them removed?
Can we set them to "No-Index", or should the robot text be used to remove them? Or can some type of removal request be made to Google?
My developers have been struggling with this issue since early June. The bloat on the site is about 175 URLs not on the site map. Is there any go to authority on this issue (it is apparently rather complicated) that can provide a definitive answer?
Thanks!!
Alan -
Yup!
-
Hi Daniel:
You are correct other factors are probably contributing to the drop. The 175 extra URLs are a contributing factor. Our site contains 310 property listing pages of which 250 have a few sentences. It appears we were penalized by Panda 4.0 in May, which apparently targets thin content.
To reverse the penalty we intend to take the following steps:
-Set all listing pages with thin content pages to "No-Index, Follow"
-Somehow remove the 175 URLs that have magically appeared in June. Either set as "no-index, follow", "no-index, no-follow" canonicalize or somehow delete use robot text. My concern is that these 175 extra URLs could be construed as thin content and could be aggravating the Panda penalty.
-Enhance content on 30-40 critical pages.Does this seem reasonable?
Thanks, Alan
-
You wrote:
The site has suffered a drop in ranking since May and we feel it prudent to keep Google from indexing useless URLs. Before May 650 pages showed on the Webmaster Tools Index status, and suddenly in early June when we upgraded the site the index grew by about 175 pages. I suspect the 120 blog archives URLs may have something to do with it. How can we get them removed?
But is it possible this is an unwarranted conclusion? Perhaps you are heading down the wrong path in attempting removal.
Have you exhausted all other possibilities?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Ecommerce Category Pages
First, let's define the terminology for the various types of ecommerce pages. The terminology differs from organization to organization: Product Description Pages (PDPs): These pages have a single product, pricing, an "add to cart" button, reviews, and a product description. Product Listing Pages (PLPs): These are product category/subcategory pages that have product image links and text links to Product Description Pages (PDPs). Category Pages: These pages have subcategory image and text links to subcategory pages. No product images are displayed Hybrid Category Pages: these pages combine sub-Category Images and text at the top of the page and product listings below. Our CMS currently does not allow us to create hybrids. This conversation revolves primarily around mobile. Our ecommerce team is having discussions around the appropriate use of PLPs vs Category pages. After doing a quick audit of the mobile sites of some top ecommerce players, there is definitely a trend to use Category Pages at the top of the category and sub-category hierarchy and use PLPs at the very bottom. The logic from a usability perspective is to allow visitors to navigate a site without ever using the hamburger navigation. ex: Baby (Category Page) => Car Seats (Category Page) => Convertible Car Seats (PLP) The sites I audited all had hamburger menus. A visitor would navigate from a home page image for "Baby," an image on the "Baby" page to "Car Seats", and an image on the "Car Seats" page to the Convertible Car Seats page. At that point, they would be able to shop for "Convertible Car Seats" on a PLP. This appears to be excellent UX and easy to use navigation. Theoretically, good for SEO as well. In short, category and subcategory pages are being used as navigation to allow visitors to easily navigate to the bottom of the hierarchy and shop on the most narrow page in the hierarchy. Much easier to use than a hamburger menu, but it does entail more clicks. The discussion revolves around allowing users to shop for product at a higher level in the taxonomy. For example, what if a visitor wants to shop all Car Seats? In the above taxonomy, we are precluding users from shopping in this manner. There is no "Car Seats" PLP. Our CMS has the ability to create both a Category Page and a PLP for "Car Seats". We could theoretically place an image on the "Car Seats" category page for "View All Car Seats", and allow users to click to a "Car Seats" PLP. None of the major ecommerce players I've audited are adding a PLP option higher up in the hierarchy. That doesn't mean that it's not good UX. Problems: From an SEO perspective, having a Category Page and a PLP for "Car Seats" would cause cannibalization - they would be competing for the same keywords. I am skeptical that canonicals would work. The pages are not near duplicate content. One page has category images, the other has product images. We could place content blocks on the page to make them more similar. We could noindex the PLP, but that's a waste of internal link juice. Need advice: Will canonicals work in this situation? Should we trash this idea entirely? Does adding a PLP add value or confusion? Is noindex a good idea? Is there an option to target keyword variations with the PLP? Is there another solution?
Web Design | | Satans_Apprentice0 -
How to find internal pages linking to a URL?
Hey, I had an issue where a client found a bad link on their site then I went to fix it and couldn't figure out where on earth it was. I tried using different software which would find the link, but not tell me where it was linked from. I asked for some help from someone in my office and they found it in about 15 seconds. Their strategy was "think like a client - just click everywhere". Is there a way to quickly find what URLs are pointing to a specific URL? Cheers
Web Design | | renegadeempire0 -
Wordpress Frameworks for SEO - Genesis - Does it Get Any Better?
I'm sure there's a ton of people in this community running Wordpress, any Genesis developers/users out there? For anybody who doesn't know, Genesis is a parent framework for building wordpress child themes. It saves a ton of time for people that aren't too handy w/ php (like me). I'm working on a few sites locally with it right now, and it's really impressive. I'm seriously never planning on using another WP framework. It also integrates perfectly with Yoast SEO, which is something not all frameworks do. So I thought I'd try to get some input from the community here, anybody have another framework they like? Or have an opinion on the SEO benefit of genesis? Would love to hear...
Web Design | | SVmedia0 -
AJAX & JQuery Tabs: Indexation & Navigation
Hi I've two questions about indexing Tabs. 1. Let's say I have tabs, or an accordion that is triggered with Jquery. That means that all HTML is accessible and indexed by search engines. But let's say a search query is relevant to the content in Tab#3, while Tab#1 is the one that's open by default. Is there any way that Tab#3 would be open directly if it's more relevant to the search query? 2. AJAX Tabs: We have pages that have Tabs triggered by AJAX (example: http://www.swisscom.ch/en/residential/help/loesung/entfernen-sie-sim-lock.html). I'm wondering about the current best practice. Google recommends HTML Snapshots. A newer SEOMoz Article talks about pushState(). What's the way to go here? Or in other words: How to get Tabs & Accordion content indexed and allow users to navigate directly to it?
Web Design | | zeepartner0 -
301 Redirect ! Joomla Pages, Already ranking. ( just wanted to change the url
hey guys hope everyone had a new year. I am ranking for a page on my site that i want to ( not specifically move ), but just change the url name: It is too long i think and i want to move it from one portion of my architecture to another menu. I have never physically done a 301 redirect myself, always had someone do it for me. I wanted some pointers. Since it is a fairly new site 4 months old! What are my options. Do i need to 301 redirect the page, if i am changing the Structure and AI of my site, or can i just change the url as is and it will still get ranked? How do i keep that url put delete the page and redirect it ? Sorry its very simple but i wanted to get the communities help to continue on ! Best Wishes HAmpig
Web Design | | BizDetox0 -
WordPress blog hosted on GoDaddy domain mapping help
We set up a WP blog that's hosted through GoDaddy. For various reasons, we purchased a URL to use to get through the technical build and set up and are trying to map that to a subdomain of our company website. (We can't host it on our own server, unfortunately). My question is: for WP blogs hosted via WP you can buy a domain mapping upgrade and I'm trying to find a similar plugin that could offer the same thing that would apply to our GoDaddy hosting and point to our subdomain (GD apparently doesn't offer the domain mapping). Anyone have any thoughts, please?
Web Design | | josh-riley0 -
Yahoo to Wordpress Permalinks
I have had a yahoo site for a couple of years. I want to start blogging so I had a worpress site built. After the site was build I noticed the urls from the previous site were not the same. For example www.besthomecaremn.com/about_us is now www.besthomecaremn.com/index-php/about_us. The company working on the site told me that that yahoo did not support permalinks and they could not make them match exactly. This is a problem because several of my pages rank differently for different terms: /about_us, /employees, /clients, /contact_us, etc, all rank differently. When they came up in the search results and were clicked on you were taken to the old site so it was like we had two sites. The company has now set that to send you to a page that says this page under routine maintenence. They are basically telling me they cannot make the urls for those pages stay the same. I am very frustrated and don't really know what to do at this point. Are they right? Can it really not be done? Can those pages alternatively be set to redirect to the new page urls or will that negatively affect the rank for those pages and how? Should I have them put the old site back up and swith hosting companies? Any advice on what to do in this situation is greatly appreciated.
Web Design | | AndreB0 -
Looking for an open source or wordpress designer that knows seo best practices
I have almost lost my patience in trying to find a web developer for our project. I have searched high and low from freelancers to us based firms. All I can find; freelancers that can't get the job done, but promise they can and us based firms that are currently getting away with murder charging through the nose on work that is not acceptable to say the least. US based Firms 1. Seem to give you as little work as possible to increase their margin. I get it we all need to make money. 2. Everyone knows how to do everything until you start telling them that you have a little education in the industry and will be testing their work. All of the sudden they no longer talk to you. 3. Got a few recommendations and they are all subpar performers. After asking them why their builds load so slow or have so many errors they have excuses that point to the customer Freelancers over seas. 1. I am not sure where to start with this. I have searched high and low in freelancer for someone that I can trust to build a site. Of course there is a ton of junk to look through. After countless hours of narrowing down the individuals I am thinking of giving a shot I find that they are not capable of the job. All I want is a new website from a firm that is honest and knows what they are doing. That is educated in seo best practices. That can build a quality website and actually has references of sites they built that are still up and running and test out alright. It is pretty bad when web development companies miss simple items like h tags. Really? Does anyone know of someone that knows what they are doing? That can work with someone that knows how to run a dvd player. Just disappointing to see all these web companies and freelancers that get away with murder. Who earns their keep in this industry?!?!?!?
Web Design | | forecastedinvestments0