Duplicate Forum Content
-
HI everyone,
great to be here, absolutely loving everything, please go easy on me I'm quite a noob when it comes to seo, but hopefully my question isn't too basic.
After running the initial checks on my websites, I found there are 7,646 duplicate pages? Some are easy fixes but the majority are not, being forum pages, the edit, quote and new post links are coming up as duplicates of the main post?
Does anyone know how to fix this?
Best Lee
-
How delightful that you refer to Invisionpower as I recently took the software for a test drive and plan to purchase it in January
A question though that has been troubling me. I use a paid for hosting service, which forwards to one of my sub-domains. The problem is I have nearly 7k pages of duplicate content (all from the forum), I really want to add a no follow and then remove the forum pages from the search index and thus remove all of the duplicate content. Though I'm worried that adding no follow to the sub domain may impact on the main site.
I have a lot of page one search positions, many long tails which combined result in a lot of visits, but I also have a couple of short phrases that get 50% of the visits alone, so I can't risk making any changes, actually I'm pretty terrified to make any changes, just in case all of my website pages are removed from the index.
-
invisionpower forum is good choice, as i knew. Found duplicated content pages here, it happens with most of forums, but there is full provision that this can resolved by canonical or stop crawling one you don't want in robots.txt.
-
Hey
just found some valuable info which has solved a lot of my problems, modified .htaccess which has removed all of the non www links, so thats a part solve.
I think what I'm going to do is purchase the new forum software, setup a robot.txt to not crawl the new forums and then once I have all of the posts transfered to the new forum, remove the old forums from the index.
That should solve it, the new forum is very well established and if need be I can pay one of their developers to incorporate some seo feature that will stop the duplicate content issue. Once thats solved I can remove the robot.txt
Many thanks, Lee
-
Hi, still one more thing, because you sound loss, and that's not the meaning of this Q&A. Contact the forumservice and ask for the canonical, this is a very simple and common thing to do.
-
Ok thanks Leonie,
still no nearer to knowing what to do, I know theres a problem and generally what I need to do, but I'm still at a complete loss as to how to do it
But thank you for trying to help,
Best, Lee
-
Seo stuff is'nt that difficult, though it can be comlicated
Anyway I wish you luck with the forum and hope you'll manage to get it the way you wanted.
Grtz, Leonie
-
Mmmm this is becoming more problematic by the minute, will need to implement robot.txt before removing the urls.
And there was me thinking this seo stuff would be easy.
-
Lol, tha'ts also an option
under url's index, though they have to be removed first, otherwise google crawl them again. but there you can remove complete directories at once.
-
or go somewhere else lol, have been considering buying invisionpower forum for a while, this might be the final push I needed.
Is there a way of mass deleting pages from the index in webmaster tools, i.e. all links that contain edit, quote and new ect?
-
Ah okay, that will be difficult than.
Maybe you can ask them to implement the canonical url. It will be helpful for you to avoid duplicates
-
is a paid forum service, but they give you the ability to add code snippets in the head.
-
Hi Lee,
What kind of CMS are you using?
In wmt under parameters you can configure parameters. If the ur's contain the same parameter it is a posibility.
-
Hi Leonie,
thanks for taking the time to answer
Not sure if that will work, there is only one head (hope that makes sense). Forums work pretty much the same as content management systems. I have the ability to change what's contained in the head, but adding rel="canonical" will have the same effect on all pages, even the duplicate one (I think).
Is there a way of removing all pages from the index (in webmaster tools) that contain the word edit, or quote or new? Kind of like using a wild card?
-
Hi Lee,
I'm not very familiar with forums. but i think you can solve it by putting a canonical in the head.
If you have a main page, which is the post, put a canonical url in it:
the duplicate pages need to have the same canonical.
I hope this work for you.
Grtz, Leonie
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What would be Best Content Starategy For My Dental Website?
Greetings to all Moz Fellows! Our organization specializes in digital dentistry, and we aim to establish a thriving blog focused on this subject to attract a wide range of clients from all across the United States. We would greatly appreciate any advice on the most effective strategies for achieving this goal.
Content Development | | SEOBrandBoca
@MOZ-LUCY1230 -
Another website copying our blog content but credit us. Still bad?
Hi Moz community, A few businesses that we work with are asking if they can leverage our content such as blogs by basically copying it and post it on their site. They will give us credit for the content though. My concern is that going to cause duplicate content issue and hurt us with our SEO? We'd like to provide it to them in a way that would benefit us or at least doesn't hurt us. I can think of a few possible options... 1. Have them only copy part of the content and link back to our site with a link "Read the original article" or something similar 2. Have them implement rel=canonical back to our site 3. Have them just copy the whole thing (because it doesn't really hurt us?). In that case, do we have them link back to us or no? Is there anything I missed? What's the best option for us? Thank you for the help in advance!
Content Development | | aphoontrakul1 -
Duplicate Content & Tags
I've recently added tags to my blog posts so that related blog posts are suggested to visitors. My understanding was that my robot.txt was handling duplicate content so thought it wouldn't be an issue but after Moz crawled by site this week is reported 56 issues of duplicate content in my blog. I'm using Shopify, so I can edit the robot.txt file but is my understanding correct that if there are 2 or more tags then they will be ignored? I've searched the Shopify documents and forum and can't find a straight answer. My understanding of SEO is fairly limited. Disallow: /blogs/+
Content Development | | Tangled
Disallow: /blogs/%2B
Disallow: /blogs/%2b0 -
What if your content is getting social shares but no links?
Suppose you have a weekly blog article and sometimes your articles earn social shares (e.g. 23 +1's on Google Plus on one article but normally 3-5 social shares). One out of 10 earns an organic link from a random blog. Would you continue publishing these blog posts?
Content Development | | ProjectLabs0 -
Does aggregating content hurt your moz / google rank?
I have a news section on my site that I aggregate from multiple RSS feeds. They are stored on my site and I have sitemap that links to them. Is this a negative thing to do? Since its overall duplicate content to another site, it may be a strike against me. Should I just leave it as an updating feed and not keep the articles visible on my site?
Content Development | | BrickPicker0 -
How can we dynamically populate content on our website based on a visitor's web history?
Recently, I have tried looking into options that would allow us to dynamically populate content (specifically images to be used at CTAs on our blog in wordpress) to different users based on their web history on our website. We would want to be able to dynamically populate images based on the number of visits in the past 60 days and the inferred industry based on pages hit. Unfortunately, I have been unable to find anything as a standalone tool - I believe HubSpot may have something like this but it is rolled into their blogging platform. Does anyone know of one?
Content Development | | SMPoulton0 -
Is there a content ratio that google looks for?
What i mean by this is: If i have a 1000 page ecommerce site that has say 10 pages of good quality content (1% good content) and a competitive site that has 100 pages of good content (10% good content) and another that has 500 (50%). if they are all almost the same in every other way the 50% content site would win hands down. however this is not always possible to have so much good content on some types of site. The question is: Is there a min percentage to aim for? Also is there a similar min rate of content production to aim for. Is their a kind of tipping point to get past that google will think they are doing things right i should keep an eye on them!
Content Development | | mark_baird0 -
How can I use my unique content to my advantage?
Hi, I run http://ablemagazine.co.uk - we also put out a print magazine every 2 months (the biggest disability magazine in Britain) This means we have loads of unique content (around 30 feature stories and 30 news stories every 2 months) Just wondering how I can use this to my advantage? I've been social bookmarking the feature stories (reddit, etc) and a link to all my unique stuff on facebook/twitter. Just wondering if there's anything else I should be doing? Thanks
Content Development | | craven220