Prevent Indexing of URLs Based on Tags
-
I started my website as a blog over at Posterous, but decided to turn it into a full scale business website with a self-hosted WordPress theme. Shortly after transitioning from Posterous to WordPress, I noticed that Google was indexing not only my old blog posts, but the URLs of my blog posts based on the tags they have. Is there any reason why this is a problem? I'm sure it shouldn't qualify as duplicate content, but for some reason it just feels a bit sloppy to me to have all of these pages indexed...Is this a non-issue? Should I just be more discriminating with my use of 'tags' if it bothers me?
-
Thanks guys. Very helpful.
-
I did a similar process a couple of years ago. I had a blog on Google's blogspot, and I set up a new, self-hosted wordpress blog and transferred all my blog posts over. Both sites were getting crawled, but the new site got no rankings until I blocked Google from crawling my old blogspot site. Google saw it as duplicate content and was only giving the old site ranking value.
-
Dan Shure wrote an excellent SEOMoz blog post about optimising wordpress earlier in the year. It really goes into all the detail you could wish for, so rather than repeat it, I'd rather just post it!
Having just quickly reminded myself of the post, it provides you with the answer I think you're looking for.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Alt tags
Do we use our main keyword only for alt tags for all images on the page?
On-Page Optimization | | Timberwink0 -
Url too long
Hi we have a wordpress website for Office Furniture Our domain name does not have office furniture in it. So we went from having domain.com/shop/category/second-sub-cat to domain.com/office-furniture/category/second-category However we now have 509 products flagged with too long urls I am wondering whether we should change back : For example domain.com/office-furniture/office-corner-desks/beech-corner-desks Should I go back to domain.com/shop/office-corner-desks/beech-corner-desks Or am I going to confuse matters even more? I should say this only affects categories as the products themselves are /shop/product I am just concerned that changing the re-direct in place originally will just make matters worse and confuse things - would I get more value changing back? Or should I stick with it and just try to shorten urls individually by product titles etc
On-Page Optimization | | KellyDSD860 -
Title Tag issue
Hello, This is a weird one. I am hoping someone can point me in the right direction. A couple months ago, we updated trinitypower.com and it was back then that I first noticed this issue, but because the home page title tag was okay and contained the primary terms for that page, I told myself I would circle back. The problem is that even though Google crawls the site everyday, it does not update the title tag text in it's index. Google: "Trinity Power Rentals" and you will see the title in the index as "Trinity Power: Temporary Power Rentals". Go to trinitypower.com and view source. You will see the title tag in the code as "Temporary Power Rentals - Trinity Power" The desc tag has been updated correctly, but I can't figure out why not the Title tag. You can look at the cache version in the index of Google. It is showing the latest version of that tag, so I really do not understand what has happened here. I am using WP Super Cache... maybe a conflict with that? I have dumped it's cache numerous times though. Please let me know what you think. Thanks, Jarrett
On-Page Optimization | | TrinityPower0 -
Sorry, but that URL is inaccessible
Our site is all on the https protocol so every time I use the on-page grader it tells me the link is unavailable. What can we do? When I use the http protocol (which is 301 redirected to the https) it still gives me the same message.
On-Page Optimization | | whiskeyfl1 -
Disallow indexing of ALL subdomains
I'm using www.domain.com as my development hosting. Each website that i'm developing get's a temporary URL like this: project1.domain.com
On-Page Optimization | | conversal
project2.domain.com
project3.domain.com
... Now i'd like to set that ALL these subdomains can not be indexed in Google. Now I manually have to do this for each subdomain's site, and when I go online I have to change the robots.txt again. So I would like to make things a bit easier for me. Is this possible?0 -
Canoncial tag for homepage?
I have a site that gets most of it's traffic from one keyword combination, but I've noticed lately that instead of sending people to the homepage, it's sending people to an internal page. This isn't a problem, except for the fact that all the best link juice and domain authority has been directed at the homepage. There's not a lot of content on the homepage, so is it worth setting up a canonical tag on the homepage for this internal page to ensure that the page authority/link juice helps to boost this page that is already being indexed for the keyword?
On-Page Optimization | | Bigheadigital0 -
Dates in URL's
I have an issue of duplicate content errors and duplicate page titles which is penalising my site. This has arisen because a number of URLs are suffixed by date(s) and have been spidered . In principle I do not want any url with a suffixed date to be spidered. Eg:- www.carbisbayholidays.co.uk/carbis-bay/houses-in-carbis-bay/seaspray.htm/06_07_13/13_07_13 http://www.carbisbayholidays.co.uk/carbis-bay/houses-in-carbis-bay/seaspray.htm/20_07_13/27_07_13 Only this URL should be spidered:- http://www.carbisbayholidays.co.uk/carbis-bay/houses-in-carbis-bay/seaspray.htm I have over 10,000 of these duplicates and firstly wish to remove them on block from Google ( not one by one ) and secondly wish to amend my robots.txt file so the URL's are not spidered. I do not know the format for either. Can anyone help please.
On-Page Optimization | | carbisbayhols0 -
What are the benefits of the URL meta tag?
We have too many meta tags and want to get rid of all the outdated ones. However, we don't want to eliminate valuable meta tags by mistake. So, before we say goodbye to the URL meta tag, we want to make sure we understand the pros and cons, if any. By the way, we are not referring to canonical URL tags, just URL as in:
On-Page Optimization | | GRIP-SEO0