How do I eliminate indexed products?
-
Please help! We got clobbered by Penguin and are at risk of having to close down after 10 years. We have been trying to figure out why and believe now it might be because of duplicate content. We added 2" inserts in March (over 500):
http://www.trophycentral.com/inserts1.html
Even though each is a different products, SEOMOZ is saying they are considered duplicate content. Given the timing, we think this might be the cause, even though it is totally legitimate.
Question - since these are now indexed and since we can't easily add content quickly, what is the best way to handle this situation? A no-index tag?
Is there a way to let Google know that their algorithm is detroying legitimate businesses??
-
Got it - thanks. I will be making the changes over the next few days. Unfortunately, I published the site last night and it will take about 18 hours so I can't access it for a while.
-
Remeber 6that should be a no-index,follow not a no-index,no-follow
-
Thanks, Alan. I had put a no-index, no-follow on the main category (inserts1.html) so that google could not get to the individual products to index them. That was the quickest thing I could do given how many products I need to update. Based on your note though, I will go through the individual products with a no-index, but it will take some time. Thanks again!
-
I can see them now - THANK YOU!!!
-
If they are noindex, then it should not be problem, but i would not no-follow as all links pointing the the no follow pages will waster their link juice, if you have no-index follow then the link jucie will flow back out of the no-indexed pages.
but having a look at the page, i can not see any no-index tag in the page
-
site:trophycentral.com -www shows all content indexed not within the www subdomain.
-
Sorry to bother you again - last question - I promise! Where did you see the mobile.trophycentral.com pages indexed? I when on to google and didn't see them in the main index. Thanks!
-
Alan, thank you! I just sent a note to the programmer who created the mobile site. For now, I am going to have them get it out of the index and I have stopped the redirection so that there is no mobile site. This may not be the best thing for the long-run, but for now I can at least be sure I fix the mobile issue. I have also fixed the strictlygifts linking. Working on removing more duplicate content now.
Thanks again!
-
This is a sad reality that many business owners face. SEO is a very complex process and unfortunately it's a case of two-fold barriers to success.
On the one hand, not all SEO's really know, or even if they do, don't consider long-term ramifications of what they might be recommending. Many of us in the industry think and act otherwise, however it is a problem nonetheless.
On the other hand, Google constantly changes their rules to a certain extent - as more people look for ways to game the system, what may have been acceptable previously can become unacceptable as Google tries to clean up the mess. It's a vicious circle.
So...
You can get "rid" of indexed pages by blocking them through a robots.txt file - if there are patterns to their URLs. if it's an entire site, you can block the whole site in one line in the robots.txt file. If it's multiple sections of a site, you can block entire sections while leaving other sections open for search indexing. A professional should be tapped to help you with that.
Its important to consider whether pages should be blocked, or instead, redirected to other pages that you want indexed or are indexed that are similar in nature.
Bad link evaluation is a professional process and should not be undertaken lightly. In many cases, site owners will ignore your requests, so it's important to at least get the request process right and to document the process. Again, a professional is needed for that.
And yes, you can submit a request after that's done.
Unfortunately, anyone you task to do the work that would be able to help you will both charge you for their time and cannot guarantee that what is done will be enough. It's another reality of the world we operate in because Google cannot reveal trade secrets to help you know what exactly needs to be done.
-
Alan, thank you so much for this. I am the founder of the business and not a webmaster, so parden these questions:
1. I originally thought it was the mobile site that caused this given the timing, but was told that somehow google was on the lookout for mobile.xxx and that it was not an issue.** I am sure you are right! How can I get rid of the indexed pages? ** I turned the mobile redirect off a couple of weeks ago so it is not even active.
2. My search provider told me they made changes to get rid of most of the pages, but since I are still seeing them, I am concerned. Is thiere something I can do to get rid of the pages?
3. I can easily change strictlygifts - this is the only thing that was intentional (but done about 8 years ago!).
4. How can I tell which are bad links - low page rank?
I have made thousands of changes based on the advice of others - improved the site speed, removed crawl errors, got rid of hundreds of pages, added duplicate content, etc. We were not given any sort of manual penalty - can I still submit a request after the above is done?
Thank you again. I have built this business over the last 10 years and to see it destroyed overnight is heartbreaking. I can't tell you how much your help is appreciated.
-
I checked a few things -you have bigger fish to fry.
Search.trophycentral.com and mobile.trophycentral.com - are either of those causing duplicate content problems on a mass scale? Google has 8k www pages indexed, and three times as many non www pages indexed.
Then looking at your inbound link profile, you've got a huge volume of inbound links from very low quality "SEO only" sites relative to your total inbound link profile. Very serious problem there.
Then you've got another site you apparently own site (StrictlyGifts.com) where you have a footer link with keywords, from every page of that site pointing to the TrophyCentral site.
The list goes on.
The cumulative impact is clearly a case of your site showing all the signs of SEO stuffing and unnatural link building. Even if some of it was unintentional (like the duplicate content conflicts across sub-domains), the pattern is clear.
1. Do all you can to get as many of the bad links removed as possible. Keep a spreadsheet of that effort.
2. Block search.trophycentral.com from search engines.
3. Either redirect mobile.trophycentral.com to the main www site and have the main www site redesigned to be flexible and responsive to different viewing platforms, or get together with a mobile SEO expert to otherwise address that duplicate content issue.
4. Add high quality unique descriptive text based content to all of your primary category and sub-category pages, and even some on every product page.
5. Consider submitting a reconsideration request to Google after you've made real headway on all of that work. Be willing to submit the spreadsheet to show links you've had removed and which you tried to but couldn't. Explain all the other steps you've taken.
You may get a bounce after that or it could just take the next Penguin update if you've done most of that before the next update.
Either way, that's just recommendations that come from only a few minutes looking at your site. There could be many other issues to address.
-
Alan, thanks. Not to sound stupid, but
1. What about the product looks like it is spam to you?
2. If I have a no index, no follow in inserts1, will that prevent goolge from all of the sub pages?
3. If the pages are already indexed, how can I get rid of them?
Sorry for the ignorant questions, but I own the business and I am not a webmaster.
Thnaks!
-
I had a quick look at this page http://www.trophycentral.com/50401.html
I found below, it is much longer thenthe sample i gave here, i would get rid of it, it looks like you are trying to spam the results
var = new Array('Have used them many times. Seamless transactions - all done through the web. Top quality product. Fast delivery. Custom engraving, including logos. Highly recommended. DR Angola, IN','This was my first order with Trophy Central, and my experience was great. I did everything on-line, the....
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Keywords are indexed on the home page
Hello everyone, For one of our websites, we have optimized for many keywords. However, it seems that every keyword is indexed on the home page, and thus not ranked properly. This occurs only on one of our many websites. I am wondering if anyone knows the cause of this issue, and how to solve it. Thank you.
Technical SEO | | Ginovdw1 -
Pages not indexed
Hey everyone Despite doing the necessary checks, we have this problem that only a part of the sitemap is indexed.
Technical SEO | | conversal
We don't understand why this indexation doesn't want to take place. The major problem is that only a part of the sitemap is indexed. For a client we have several projects on the website with several subpages, but only a few of these subpages are indexed. Each project has 5 to 6 subpages. They all should be indexed. Project: https://www.brody.be/nl/nieuwbouwprojecten/nieuwbouw-eeklo/te-koop-eeklo/ Mainly subelements of the page are indexed: https://www.google.be/search?source=hp&ei=gZT1Wv2ANouX6ASC5K-4Bw&q=site%3Abrody.be%2Fnl%2Fnieuwbouwprojecten%2Fnieuwbouw-eeklo%2F&oq=site%3Abrody.be%2Fnl%2Fnieuwbouwprojecten%2Fnieuwbouw-eeklo%2F&gs_l=psy-ab.3...30.11088.0.11726.16.13.1.0.0.0.170.1112.8j3.11.0....0...1c.1.64.psy-ab..4.6.693.0..0j0i131k1.0.p6DjqM3iJY0 Do you have any idea what is going wrong here?
Thanks for your advice! Frederik
Digital marketeer at Conversal0 -
Unique page for each product variant? (Not eCommerce)
Hi Mozzers, Just looking for a little advice before I launch into a huge workload. We have landing pages for vehicle manufacturers. We then have anchor links in that page for each vehicle model that manufacturer has, with further info on the model further down the page. So we're toying with the idea of launching a unique page for each of the models rather than having them all on the same landing page. This will take an age and a minute but if it is worth it, we want to do it. Do you guys see a benefit to having unique pages for each model? Do you think it would attract more natural links? Would this help or hinder the manufacturer landing page in general? Should the manufacturer landing page be noindex so as to avoid duplicate content issues? I can see a lot of work and risk, just looking for a few opinions. PM for more info. Thanks a lot people, Jamie
Technical SEO | | SanjidaKazi0 -
Mobile site not getting indexed
My site is www.findyogi.com - a shopping comparison site The mobile site is hosted at m.findyogi.com I fixed my sitemap and attribution to mobile site in May last week. My mobile site pages are getting de-indexed since then. Website - www.findyogi.com/mobiles/motorola/motorola-moto-g-16gb-b95ef8/price - indexed Mobile - m.findyogi.com/mobiles/motorola/motorola-moto-g-16gb-b95ef8/price - _not indexed. _ Google is crawling my website and mobile site normally. What am I am doing wrong?
Technical SEO | | namansr0 -
URL Structure for Product Pages
Hi Moz Community. I'm in need of some URL structure advice for product pages. We currently have ~4,000+ products and I'm trying to determine whether I need a new URL structure from the previous site owners. There are two current product URL structures that exist in our website: 1.http://www.example.com/bracelets/gold-bracelets/1-1-10-ct-diamond-tw-slip-on-bangle-14k-pink-gold-gh-i1-i2/ (old URL structure)
Technical SEO | | IceIcebaby
2. http://www.example.com/gemstone-bracelet-prd-bcy-121189/ (new URL structure) The problem is that half of our products are still in the old structure (no one moved them forward), but at the same time I'm not sure if the new structure is optimized as much as possible. Every single gemstone bracelet, or whatever product will have the same url structure, only being unique with the product number at the end. Would it be better to change everything over to more product specific URLS. I.e. example.com/topaz-gemstone-dangle-bracelet. Thanks for your help!
-Reed0 -
Yahoo and Bing do not index all pages
Only 20% of our pages are indexed by Bing and Yahoo although we have correctly submitted the sitemap to bing webmaster tools and other search engines index all our content. Do you have any suggestions?
Technical SEO | | AEM130 -
How to tell if PDF content is being indexed?
I've searched extensively for this, but could not find a definitive answer. We recently updated our website and it contains links to about 30 PDF data sheets. I want to determine if the text from these PDFs is being archived by search engines. When I do this search http://bit.ly/rRYJPe (google - site:www.gamma-sci.com and filetype:pdf) I can see that the PDF urls are getting indexed, but does that mean that their content is getting indexed? I have read in other posts/places that if you can copy text from a PDF and paste it that means Google can index the content. When I try this with PDFs from our site I cannot copy text, but I was told that these PDFs were all created from Word docs, so they should be indexable, correct? Since WordPress has you upload PDFs like they are an image could this be causing the problem? Would it make sense to take the time and extract all of the PDF content to html? Thanks for any assistance, this has been driving me crazy.
Technical SEO | | zazo0 -
Does Google index XML files?
Does Google or other search engines include XML files in their index? More specifically, I am wondering how Google knows the difference between an xml filetype and an RSS feed.
Technical SEO | | nicole.healthline0