Duplicate Forum Content
-
HI everyone,
great to be here, absolutely loving everything, please go easy on me I'm quite a noob when it comes to seo, but hopefully my question isn't too basic.
After running the initial checks on my websites, I found there are 7,646 duplicate pages? Some are easy fixes but the majority are not, being forum pages, the edit, quote and new post links are coming up as duplicates of the main post?
Does anyone know how to fix this?
Best Lee
-
How delightful that you refer to Invisionpower as I recently took the software for a test drive and plan to purchase it in January
A question though that has been troubling me. I use a paid for hosting service, which forwards to one of my sub-domains. The problem is I have nearly 7k pages of duplicate content (all from the forum), I really want to add a no follow and then remove the forum pages from the search index and thus remove all of the duplicate content. Though I'm worried that adding no follow to the sub domain may impact on the main site.
I have a lot of page one search positions, many long tails which combined result in a lot of visits, but I also have a couple of short phrases that get 50% of the visits alone, so I can't risk making any changes, actually I'm pretty terrified to make any changes, just in case all of my website pages are removed from the index.
-
invisionpower forum is good choice, as i knew. Found duplicated content pages here, it happens with most of forums, but there is full provision that this can resolved by canonical or stop crawling one you don't want in robots.txt.
-
Hey
just found some valuable info which has solved a lot of my problems, modified .htaccess which has removed all of the non www links, so thats a part solve.
I think what I'm going to do is purchase the new forum software, setup a robot.txt to not crawl the new forums and then once I have all of the posts transfered to the new forum, remove the old forums from the index.
That should solve it, the new forum is very well established and if need be I can pay one of their developers to incorporate some seo feature that will stop the duplicate content issue. Once thats solved I can remove the robot.txt
Many thanks, Lee
-
Hi, still one more thing, because you sound loss, and that's not the meaning of this Q&A. Contact the forumservice and ask for the canonical, this is a very simple and common thing to do.
-
Ok thanks Leonie,
still no nearer to knowing what to do, I know theres a problem and generally what I need to do, but I'm still at a complete loss as to how to do it
But thank you for trying to help,
Best, Lee
-
Seo stuff is'nt that difficult, though it can be comlicated
Anyway I wish you luck with the forum and hope you'll manage to get it the way you wanted.
Grtz, Leonie
-
Mmmm this is becoming more problematic by the minute, will need to implement robot.txt before removing the urls.
And there was me thinking this seo stuff would be easy.
-
Lol, tha'ts also an option
under url's index, though they have to be removed first, otherwise google crawl them again. but there you can remove complete directories at once.
-
or go somewhere else lol, have been considering buying invisionpower forum for a while, this might be the final push I needed.
Is there a way of mass deleting pages from the index in webmaster tools, i.e. all links that contain edit, quote and new ect?
-
Ah okay, that will be difficult than.
Maybe you can ask them to implement the canonical url. It will be helpful for you to avoid duplicates
-
is a paid forum service, but they give you the ability to add code snippets in the head.
-
Hi Lee,
What kind of CMS are you using?
In wmt under parameters you can configure parameters. If the ur's contain the same parameter it is a posibility.
-
Hi Leonie,
thanks for taking the time to answer
Not sure if that will work, there is only one head (hope that makes sense). Forums work pretty much the same as content management systems. I have the ability to change what's contained in the head, but adding rel="canonical" will have the same effect on all pages, even the duplicate one (I think).
Is there a way of removing all pages from the index (in webmaster tools) that contain the word edit, or quote or new? Kind of like using a wild card?
-
Hi Lee,
I'm not very familiar with forums. but i think you can solve it by putting a canonical in the head.
If you have a main page, which is the post, put a canonical url in it:
the duplicate pages need to have the same canonical.
I hope this work for you.
Grtz, Leonie
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Reviving a (very) old blog - is it worth shifting the content onto a new blog?
I look after a few ecommerce sites, one of them doesn't currently have a blog, we are setting up a wordpress blog now for the site. Going way back in time the site did have a blog which was on a separate Typepad domain. What I'm wondering is whether it is worth redirecting this whole blog to the new blog section of the site and copying some of the content over to the new blog as historical posts? I don't think it will be possible to redirect each individual post to a new one so it will just be a straight redirect of the old blog domain to the new one with the same (most of anyway) content. Do you think it is worth doing this for the value of this content which is relevant but dated (many of the links are now expired)? Doing this will take some time to do so it's not 'free' content we'd be getting We have a lot of new content planned out so we won't be short of content, just would be nice to have some historical content on there too Thanks
Content Development | | PeterLeatherland0 -
Can We Publish Duplicate Content on Multi Regional Website / Blogs?
Today, I was reading Google's official article on Multi Regional website and use of duplicate content. Right now, We are working on 4 different blogs for following regions. And, We're writing unique content for each blog. But, I am thinking to use one content / subject for all 4 region blogs. USA: http://www.bannerbuzz.com/blog/ UK: http://www.bannerbuzz.co.uk/blog/ AUS: http://www.bannerbuzz.com.au/blog/ CA: http://www.bannerbuzz.ca/blog/ Let me give you very clear ideas on it. Recently, We have published one article on USA website. http://www.bannerbuzz.com/blog/choosing-the-right-banner-for-your-advertisement/ And, We want to publish this article / blog on UK, AUS & CA blog without making any changes. I have read following paragraph on Google's official guidelines and It's inspire me to make it happen. Which is best solution for it? Websites that provide content for different regions and in different languages sometimes create content that is the same or similar but available on different URLs. This is generally not a problem as long as the content is for different users in different countries. While we strongly recommend that you provide unique content for each different group of users, we understand that this may not always be possible. There is generally no need to "hide" the duplicates by disallowing crawling in a robots.txt file or by using a "noindex" robots meta tag. However, if you're providing the same content to the same users on different URLs (for instance, if both example.de/ and example.com/de/ show German language content for users in Germany), you should pick a preferred version and redirect (or use the rel=canonical link element) appropriately. In addition, you should follow the guidelines on rel-alternate-hreflang to make sure that the correct language or regional URL is served to searchers.
Content Development | | CommercePundit0 -
Content: Best Blogs Article
Hello, For an Ecommerce site, I think a good way to get known is to write a "Best X Blogs" article, where X is a topic in your industry, and then letting the people you link to know about the article. I got the idea from a Mozinar. My question is, how close does the X from above have to be in your niche? For example, if your product is running shoes can you write a "best athlete blogs" article? I'm worried about them reading the article, then leaving. In some smaller niches the topics closest to the product don't have much in the way of blogs out there. So how close to your niche does the Best X Blogs topic have to be?
Content Development | | BobGW0 -
Should I put the date on a new content page to show users when it was written or updated?
I've been asked this question at work and not certain of the answer. Personally if I see an 'old' date in a meta description on Google I often scan for more recent articles. In other words it can act as a deterrent. We are a very big social networking site with a large content section. For some of our content the date might be relevant, such as legal information, but often it isn't. Are there any SEO factors in dating content?
Content Development | | CecilyP0 -
Fresh content ideas for a static site?
I have an ecommerce site. My home page is set-up just as I want it. I'm not looking to redo it or change my site to a blog. Just looking for some new, different, SEO friendly ideas or concepts to keep it "fresh".
Content Development | | VictorVC0 -
Help with Content Revamp
Many years ago we wrote about 60 content pages for our surfboard e-commerce website targeting all the top popular keywords. Many of them generic but very keyword focused. We are now revamping our content our our site and want to move away from the generic side of things and actually rewrite all the pages to make them very useful and actually stuff our customers can really use and will find very helpful. I noticed that many times we wrote small pages less than 500 words that target similar keywords around a general theme. In looking at the analytics all the pages are getting a good amount of traffic and ranking well but im wondering would it be ok to focus on a main topic and combine similar pages if they are related? So i can take the say 60 articles and combine it down to say 10 articles and make the articles cover alot more stuff instead of just being small 500 word articles. As an example we have many surfboard models so we wrote an article for -Longboard Surfboards -Funboard Surfboards -Mini Malibu Surfboards -Retro Fish Surfboards -Womens Surfboards -Beginner Surfboards My question is could i weave these all together and write one long guide on say "Choosing The Type of Surboard you need" and cover all the board models in that article and then redirect the old pages to point to that one article. Would i still rank well for all these words Or would this destroy all my current rankings for these words? What is the best approach to rewriting and or combining old content pages that currently rank well but could be combined with others around the same theme to make it more user friendly?
Content Development | | isle_surf0 -
Integration of content on other sites
(by Google Traductor) Hello, we are able to make agreements with sites of good quality and reputation to integrate our classified ads for agropeuariosector on the websites of these companies. We fear that thesesites begin to index all this content and begin to compete with us in organic positioning. On the other hand this would generateduplicate content? That strategy will be applied in order to do so. Greetings and thanks!
Content Development | | romaro
Robert0 -
Ideas for making a mini-content farm more valuable to end users
I run a mini-content farm so to speak - a nationwide computer repair business. We have screened professionals that are specific to one industry. I was wondering if the SEO community would like to offer ideas on how to make this type of site more interesting to end users. What are some things that could be integrated into the site that are 'location specific' that would be of interest to users. I'd like to be able to offer a list of certified, screen, professionals that is searchable by zip code and town. We are planning on showing the quality control rating, as well as current certifications, and a checkbox showing that they were background checked. Customer testimonials are also in the works. Any other ideas?
Content Development | | ilyaelbert0