Index or not index Categories
-
We are using Yoast Seo plugin. On the main menu we have only categories which has consist of posts and one page. We have category with villas, category with villa hotels etc.
Initially we set to index and include in the sitemap posts and excluded categories, but I guess it was not correct.
Would be a better way to index and include categories in the sitemap and exclude the posts in order to avoid the duplicate? It somehow does not make sense for me, If the posts are excluded and the categories included, will not then be the categories empty for google? I guess I will get crazy of this.
Somebody has perhaps more experiences with this?
-
No problem at all, glad I could help!
Good luck with the site!
-
You are really amazing Lewis! I understand what you mean with no indexing the pages 2, 3 etc..Yoast has there such option that I can mark it and it will not be indexing them.
Thank you so much for the tool you gave me to visit yoast site!!! It worked! Now I can learn more about it and figure out what is the best. This is clear that they have blocked ips from Kenya, although they have claimed they do not do that, and we paid almost 100usd for the plugin
Thank you very much Lewis!
-
Hi Iris,
Yes, you want the URLs to be included in the sitemap too as this is what the search engines will use to build a map of your website and list them in their search engines.
With regards to your duplicate page issue, this is to do with your pagination of the pages. There's a guide here which tells you the SEO best practices when it comes to handling pagination, so hopefully this will help - http://searchengineland.com/the-latest-greatest-on-seo-pagination-114284
Really, you don't want those additional pages to be picked up in the search engines, so a fix will need to be sorted for that. You'll probably need to find a developer / a plugin to allow you to not index the /2 /3 pages etc.
I don't do much work with Wordpress, so maybe someone else could advise you with regards to the archive section. If your categories and posts are indexed, then I would have thought that you've done the correct thing with the archives and set them to noindex. That being said, I have limited knowledge of carrying out SEO for wordpress so I would need to take a closer look into that to give you a better response..
Hope this helps at least a little!
On a separate note, you could try accessing the Yoast website through a proxy such as http://hidemyass.com/ - Might be worth a go?
-
You are amazing Lewis, thank you so much for your time. The posts in categories are displayed only with short summary, so I guess it should be alright then. Should they also be all included in the sitemap? I am very scared of duplicate content.
Also every category has approximately 3 pages and now the moz crawl shows me that I have duplicate pages like this below and that it does not know which one is canonical:
I am not sure how to sort this out.
I have there also some archive post which says under: "Note: instead of templates these are the actual titles and meta descriptions for these custom post type archive pages."
I set the archives on noindex as i do not want the archives with post shoved in search result, but the categories. I hope this is correct. There are also some options and media, oh my god it's killing me:-( I have no idea what it is.
The reason why I am so annoying with this is that I can't access yoast site, his support team is looking into it why, but did not get back to me yet:-( I guess they have blocked ips from Kenya although they said me they don't do this.
Thank you very much Lewis for all you have done for me already!
-
I'm not sure if I fully understand your question, but I'll give it my best shot to answer it.
If I was in your position, I would set the Yoast plugin to index both the categories and the posts, but make sure that the posts only show a short summary / the first 'x' number of words than the post. The reason behind doing this is similar to how an ecommerce store works.
On eCommerce stores, you have your categories which are used as funnels to find inner product pages. Categories are generally set to be indexed as they combine lots of relevant data for a user which helps create a better user experience. In your case, your category may be 'Villas' and inside that, you may list 20 individual Villas. If you didn't have your category pages indexed, you'd be relying on the search engine to filter a user down to either your homepage or one specific villa which you hope is right for the users choice (which most likely will result in a higher bounce rate).
Again, I'm not sure if I've understood exactly what you're looking for, but that's what I would recommend if you're asking which sections of your site should be indexed. Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Question on Indexing, Hreflang tag, Canonical
Dear All, Have a question. We've a client (pharma), who has a prescription medicine approved only in the US, and has only one global site at .com which is accessed by all their target audience all over the world.
Intermediate & Advanced SEO | | jrohwer
For the rest of the US, we can create a replica of the home page (which actually features that drug), minus the existence of the medicine, and set IP filter so that non-US traffic see the duplicate of the home page. Question is, how best to tackle this semi-duplicate page. Possibly no-index won't do because that will block the site from the non-US geography. Hreflang won't work here possibly, because we are not dealing different languages, we are dealing same language (En) but different Geographies. Canonical might be the best way to go? Wanted to have an insight from the experts. Thanks,
Suparno (for Jeff)1 -
Url title and then category vice versa
We have recently developed a site with the structure of domain.com/page-title/about/category Instead of the traditional domain.com/category/page-title We want to optimize more on each single article rather than the category its in. However now we get the info from a seo company that this is rather a bad idea and it hurts the SEO performance because google doesnt understand the structure. The archive page of each category is domain.com/category/overview Whats your input on this?
Intermediate & Advanced SEO | | Preen0 -
Why is wrong domain being indexed?
We have 2 domains: revolve.com and fwrd.com (unrelated to each other, but hosted on the same server). If you do a site search for revolve.com but enter a designer brand that is only carried on FWRD (not on Revolve), the domain "revolve.com" pops up in the SERP, which is redirected to FWRD.com. Ex. https://www.google.com/webhp?sourceid=chrome-instant&ion=1&espv=2&ie=UTF-8#q=site%3Awww.revolve.com isabel marant Why is Google indexing the revolve.com pages, which don't actually exist? Thanks.
Intermediate & Advanced SEO | | ggpaul5620 -
Date of page first indexed or age of a page?
Hi does anyone know any ways, tools to find when a page was first indexed/cached by Google? I remember a while back, around 2009 i had a firefox plugin which could check this, and gave you a exact date. Maybe this has changed since. I don't remember the plugin. Or any recommendations on finding the age of a page (not domain) for a website? This is for competitor research not my own website. Cheers, Paul
Intermediate & Advanced SEO | | MBASydney0 -
Old pages still in index
Hi Guys, I've been working on a E-commerce site for a while now. Let me sum it up : February new site is launched Due to lack of resources we started 301's of old url's in March Added rel=canonical end of May because of huge index numbers (developers forgot!!) Added noindex and robots.txt on at least 1000 urls. Index numbers went down from 105.000 tot 55.000 for now, see screenshot (actual number in sitemap is 13.000) Now when i do site:domain.com there are still old url's in the index while there is a 301 on the url since March! I know this can take a while but I wonder how I can speed this up or am doing something wrong. Hope anyone can help because I simply don't know how the old url's can still be in the index. 4cArHPH.png
Intermediate & Advanced SEO | | ssiebn70 -
All In One SEO PACK Configuration - Index or Noindex?
I'm finding conflicting information about the right way to configure the All in One SEO Pack wordpress plugin. Do I index or noindex for the items below? Use noindex for Categories - yes or no? Use noindex for Archives - yes or no? Use noindex for Tag Archives - yes or no?
Intermediate & Advanced SEO | | webestate0 -
Recently created site indexed; no backlinks showing?
I launched a website for a client in mid-March. The site is already indexed, I have built quite a few links to it (links are also indexed), and ranks well for some targeted keywords. However, when I try to check backlinks to the site with Open Site Explorer, it comes back with "No Data Available For This URL". Is this something I should be worried about or merely a case of 'recency' of page creation'? I know it says that it can take 45-60 days for a site to be included in Linkscape but I'm approaching the 60 days mark and still nothing.
Intermediate & Advanced SEO | | Igor-Avidon0 -
Magento: URLs for Products in Multiple Categories
I am working in Magento to build out a large e-commerce site with several thousand products. It's a great platform, but I have run into the issue of what it does to URLs when you put a product into multiple categories. Basically, "a book" in two categories would make two URLs for one product: 1) /books/a-book 2) author-name/a-book So, I need to come up with a solution for this. It seems I have two options: Found this from a Magento SEO article: 'Magento gives you the ability to add the name of categories to path for product URL's. Because Magento doesn't support this functionality very well - it creates duplicate content issues - it is a very good idea to disable this. To do this, go to System => Configuration => Catalog => Search Engine Optimization and set "Use categories path for product URL's to "no".' This would solve the issues and be a quick fix, but I think it's a double edged sword, because then we lose the SEO value of our well named categories being in the URL. Use Canonical tags. To be fair, I'm not even sure this is possible. Even though it is creating different URLs and, thus, poses a risk of "duplicate content" being crawled, there really is only one page on the admin side. So, I can't go to all of the "duplicate" pages and put a canonical tag, because those duplicate pages don't really exist on the back-end. Does that make sense? After typing this out, it seems like the best thing to do probably will be to just turn off categories in the URL from the admin side. However, I'd still love any input from the community on this. Thanks!
Intermediate & Advanced SEO | | Marketing.SCG0