Tags showing up in Google
-
Yesterday a user pointed out to me that Tags were being indexed in Google search results and that was not a good idea. I went into my Yoast settings and checked the "nofollow, index" in my Taxanomies, but when checking the source code for no follow, I found nothing.
So instead, I went into the robot.txt and disallowed /tag/
Is that ok? or is that a bad idea? The site is The Tech Block for anyone interested in looking.
-
Anyone know the answer to this?
-
If you guys wouldn't mind doing me this favor...
Go here: http://thetechblock.com/tag/microsoft
and search the source code for "noindex"
I'm not seeing it.... or am I doing this wrong?
-
well i would not do the robots.txt because you still want the pages to be crawled for better indexing of your post pages and the robots.txt blocks the bots from crawling in addition to indexing, you want crawling just not indexing.
Are you sure it's not in your search code, sometimes it populates in an unexpected place in your template - do a find command for "noindex"
-
Thanks for your response Nakul. For some reason though when those boxes are checked it still isn't showing "noindex" in the source code. Why could that be?
-
It should be a noindex. You don't want them to appear, right ? In that case, it's best to do a noindex. However, since you have already done a robots.txt disallow, the bots won't be able to read the pages any more (most of the bots). So your solution will work, it's more like a brute force method, but will work.
The right way is to do a noindex.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Meta descriptions for specific categories/tags not showing?
Hi -- I'm really confused as to why only certain blog categories are not able to be crawled for their descriptions when their source codes look identical to other, crawlable pages on the same site? Specifically, Moz/other tools are not able to pull a meta description from the page http://www.koonz.com/category/videos/premises-liability-videos (and a few others) - while the source code looks almost identical to http://www.koonz.com/category/videos/federal-torts-claims-act-videos ?? Can anyone shed some light into possible issues for me? Thanks in advance!
Technical SEO | | jessicamcdaniel0 -
Weird Cigarette URLs showing up in Google Webmaster Tools
Hi there, I'm noticing a bunch of URLs showing up in my google webmaster tools that are all cigarette related (they are appearing as 404s in the crawl error report). They are throwing 404 errors which is why they are listed here... Anyone have any idea of what this could be? I recently switched from Wordpress to Shopify and these weird URLs just started appearing on my webmaster tools in the last week. Kinda bizarre / a little alarming! Thanks,
Technical SEO | | TheBatesMillStore
Bianca0 -
Google site: operator showing only 30 results for whatever website you may like, omitting the rest
site:wikipedia.org site:seomoz.org site:nytimes.com site:WHATEVER YOU PUT HERE 🙂 is currently always showing just 3 SERP pages and the well known ugly message: In order to show you the most relevant results, we have omitted some entries very similar to the 30 already displayed.
Technical SEO | | j.royal
If you like, you can repeat the search with the omitted results included. Any idea what's going on?!!? Ongoing update?0 -
Crawling issues in google
Hi everyone, I think i have crawling issues with one of my sites. It has vanished form Google rankings it used to rank for all services i offered now it doesn't anymore ever since September 29th. I have resubmitted to Google 2 times and they came back with the same answer: " We reviewed your site and found no manual actions by the web spam team that might affect your site's ranking in Google. There's no need to file a reconsideration request for your site, because any ranking issues you may be experiencing are not related to a manual action taken by the webspam team. Of course, there may be other issues with your site that affect your site's ranking. Google's computers determine the order of our search results using a series of formulas known as algorithms. We make hundreds of changes to our search algorithms each year, and we employ more than 200 different signals when ranking pages. As our algorithms change and as the web (including your site) changes, some fluctuation in ranking can happen as we make updates to present the best results to our users. If you've experienced a change in ranking which you suspect may be more than a simple algorithm change, there are other things you may want to investigate as possible causes, such as a major change to your site's content, content management system, or server architecture. For example, a site may not rank well if your server stops serving pages to Googlebot, or if you've changed the URLs for a large portion of your site's pages. This article has a list of other potential reasons your site may not be doing well in search. " How i detected that it may be a crawling issue is that 2 weeks ago i changed metas - metas are very slow in getting updated and for some of my pages never did update Do you know any good tools to check for bad code that could slow down the crawling. I really don't know where to look other than issues for crawling. I validated the website with w3c validator and ran xenu and cleaned these up but my website is still down. Any ideas are appreciated.
Technical SEO | | CMTM0 -
Use of Multiple Tags
Hi, I have been monitoring some of the authority sites and I noticed something with one of them. This high authority site suddenly started using multiple tags for each post. And I mean, loads of tags, not just three of four. I see that each post comes with at least 10-20 tags. And these tags don't always make sense either. Let's say there is a video for "Bourne Legacy", they list tags like bourne, bourney legacy, bourne series, bourne videos, videos, crime movies, movies, crime etc. They don't even seem to care about duplicate content issues. Let's say the movie is named The Dragon, they would inclue dragon and the-dragon in tags list and despite those two category pages(/dragon and /the-dragon) being exactly the same now, they still wouldn't mind listing both the tags underneath the article. And no they don't use canonical tag. (there isn't even a canonical meta on any page of that site) So I am curious. Do they just know they have a very high DA, they don't need to worry about duplicate content issues? or; I am missing something here? Maybe the extra tags are doing more good than harm?
Technical SEO | | Gamer070 -
Should I use these Meta Tags or Remove it?
Hi, I have a lot of older pages that I am cleaning up older pages, and I see that I have <title>Actual Title</title> (I understand the importance of this tag.) (I have some text in this meta tag on a lot of pages, sometimes matching my title tag exactly but in some cases I treated it like a mini description. Should I remove the on my pages, or keep it and make sure it is the exact as the main Title Tag. -------- Question about meta tag #2. I have heard rumors that the keywords tag should be removed. example: Thanks in advance! Force7
Technical SEO | | Force70 -
How to improve my google backlinks
Hi i have just checked my google back links for my site www.in2town.co.uk and it has said that i have only five, not sure where these are from as the tool i was using did not tell me. But i have looked at my compeditors and they have a few hundred and some have thousands so i am just wondering what i need to do to compete and get more backlinks. I have been writing articles for other sites, free article sites hoping to get some traffic as well as backlinks, for this has not worked out. i just done a report now and i have got the following information DMOZ Directory ? NoYahoo Directory ? NoDigg 0 Yahoo Indexed Pages ? 0 Bing Indexed Pages 0 I would really like to know what steps i need to take as i feel that i have done a lot of good work but my back links are not improving. any help would be great
Technical SEO | | ClaireH-1848860 -
Problems with google cache
Hi Can you please advise if the following website is corrupted in the eyes of Google, it has been written in umbraco and I have taken over it from another developer and I am confused to why it is behaving the way it is. cache:www.tangoholidaysolutions.com When I run this all I see is the header, the start of the main content and then the footer. If I view text view all the content is visible. The 2nd issue I have with this site is as follows: Main Page: http://www.tangoholidaysolutions.com/holiday-lettings-spain/ This page is made up of widgets i.e. locations, featured villas, content However the widgets are their own webpages in their own right http://www.tangoholidaysolutions.com/holiday-lettings-spain/location-picker/ My concern is that this part pages will affect the performance of the seo on the site. In an ideal world I would have the CMS setup so these widgets are not classed as pages, but I am working on this. Thanks Andy
Technical SEO | | iprosoftware0