Noindex pages being indexed
-
Hi all
Wondering if anyone could offer a pointer on a problem i am having please. I am developing an affiliate store and to prevent problems with duplicate content I have added name="robots" content="NOINDEX,FOLLOW" /> to all the product pages to avoid google penalties.
However, Google appears to be indexing product pages. When I do a site: search I see a few hundred product pages in the engine. This is odd as the site has always had noindex on these pages. Even viewing the cache of the indexed page shows the noindex meta tag to be in place.
I'm at a loss as to why these pages are being indexed and could do with removing them asap to stop any penalties on the site.
Many thanks for any help.
-
Thanks for taking the time to look at the site.
Not sure why the code is coming in the wrong place it is using a magento seo plugin so will need to chase them up on that. Just searched a random selection of pages and the code seems to be in the header section on all of those, so it seems there are some pages not playing nicely.
I would like to index the product pages but there are over 250,000 items pulled from the merchants and no chance of writing that much unique content so I feel safest to noindex them all. The main traffic strategy will be to use content which will promote items, such as fashion advice pieces etc.
In the example you give, that seems to be a problem with the categories, will check that out, thanks for pointing it out.
-
Okay, i have found the indexing problem. The noindex meta tag should be placed within the head section of your HTML. It is now in your body content so it's not getting used.
Are you sure you want to no-index product pages though? These are very important pages on your site and there are other ways to fix duplicate content issues.
Most duplicate content issues on pages comes from the fact that most CMS systems have the same product at different URL's. On your site i see http://yochic.co.uk/dress-267864/bodycon/black-cut-out-side-bodycon-dress.html and http://yochic.co.uk/black-cut-out-side-bodycon-dress.html
Same product, different URL. This could be fixed by adding a rel="canonical" on product pages which links back to the preferred version. Easiest would be to link back to www.domain.com/product.html
This would solve most duplicate content issues without having to deindex them.
Hope i was helpful, if you have any questions left, feel free to ask me.
-
hi, yes, maybe should have added that to start with. The site is yochic. co. uk - it is still being worked on so bear that in mind with random products in the wrong places or wonky looking menus.
The category pages are set to be indexed so no problem there, the product pages are the ones which contain the most duplicate content so have been blocked, but a number are still going in the listing.
-
Perhaps you could give us a link to your website using the following notation: domainname (dot) TLD It's difficult to tell you what the problem is without being able to take a look at your site.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Will it upset Google if I aggregate product page reviews up into a product category page?
We have reviews on our product pages and we are considering averaging those reviews out and putting them on specific category pages in order for the average product ratings to be displayed in search results. Each averaged category review would be only for the products within it's category, and all reviews are from users of the site, no 3rd party reviews. For example, averaging the reviews from all of our boxes products pages, and listing that average review on the boxes category page. My question is, will this be doing anything wrong in the eyes of Google, and if so how so? -Derick
On-Page Optimization | | Deluxe0 -
On-Page Optimization Question
My company sells Blue widgets and we are located in Denver, CO. Keyword research indicates that the the highest volume phrase is "blue widgets for sale in denver co". Should my meta title tag be: Blue Widgets for sale in Denver CO , and my h1 tag be the same? or should they be semantic phrases? Thanks in advance!
On-Page Optimization | | FicklingCompany0 -
Page Layout Updates and Mobile Pages with Ads
I have been trying to do some research on the Page Layout Algorithm and Top Heavy Ads and much of what I read does not mention about mobile pages as apposed to desktop. I am curious if the Page Layout updates can be effected by mobile pages as well and if there is any good articles on this subject. Also is this Algorithm been incorporated into its regular algorithm or do we still have to wait for refreshes to see the impact? Cesar
On-Page Optimization | | cbielich0 -
Is there any decent web browser that still displays the full page title at the top of the page?
I just updated to the latest version of Firefox on my Mac and saw that they now hide most of the page title in the browser tab, like Chrome and Safari. I like to be able to see the full page title at all times (for reasons I'm sure you all understand) and that's pretty much the only reason I stuck with Firefox all these years. Now I'm looking for an alternative – any suggestions?
On-Page Optimization | | matt-145671 -
Keywords per Page
Iv'e looked through the QA here and there are a lot of different conflicting opinions on what is a generally a good idea. For Example Florist Clearwater Clearwater Florist Florist in Clearwater Florist in Clearwater FL Clearwater FL Florist Clearwater Florida Florist Florist in Clearwater Florida Florist near Clearwater FL etc.... So for something like this example....should I have one page represent all of these keyword iterations or split them among different pages?
On-Page Optimization | | BenGMKT0 -
Will Google re-index the page if content is changed/improved?
Hello,
On-Page Optimization | | wickedsunny1
i have a little question, it seems most of my posts which are 3 years old or even more, all have almost same type of 2-3 lines of text at post starting and then images roundups etc.
which recently stopped getting any traffic from google. Probably becuase of lack in text etc.
So if i now edit those old pages, will they be reindexed in google with this new content/data?
thanks in advance.
cheers0 -
Why is the seomoz showing it crawled 3 pages when i only have 2 pages?
I had seomoz crawl my site. I only have 2 pages. The site url is www.autoinsurancefremontca.com.
On-Page Optimization | | Greenpeak0 -
What do you do with old web pages?
I have a wordpress blog that I've made a ton of changes to. I have about a dozen pages on it that have old information or I no longer have a use for. In retrospect, I probably should have used the old pages for new content instead of building new pages. Should I just leave them on the site with no links to them, should I mark them as noindex, or should I delete them? I think some of the old pages could be completing with my new pages for ranking due to similar content. Website is: http://continuumweddings.com if you'd like to check out my site. Thanks, Melissa
On-Page Optimization | | mrsmelmitch0