Adding non-important folders to disallow in robots.txt file
-
Hi all,
If we have many non-important folders like /category/ in blog.....these will multiply the links. These are strictly for users who access very rarely but not for bots. Can we add such to disallow list in robots to stop link juice passing from them, so internal linking will me minimised to an extent. Can we add any such paths or pages in disallow list? Is this going to work pure technical or any penalty?
Thanks,
Satish
-
But as per the current SEO buzz, internal nofollow leads of waste of link juice and we cannot preserve it. Moreover some suggests not to use nofollow internally.
-
This is a great resource for all things robots.txt related: [http://www.robotstxt.org/robotstxt.html](http://www.robotstxt.org/robotstxt.html)
-
Hi,
Yes you can block in robots.txt. You can also use rel="nofollow" if you don't want to pass link juice.
[No Link Juice](https://www.example.com) Hope this helps. Thanks
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Meta robots at every page rather than using robots.txt for blocking crawlers? How they'll get indexed if we block crawlers?
Hi all, The suggestion to use meta robots tag rather than robots.txt file is to make sure the pages do not get indexed if their hyperlinks are available anywhere on the internet. I don't understand how the pages will be indexed if the entire site is blocked? Even though there are page links are available, will Google really index those pages? One of our site got blocked from robots file but internal links are available on internet for years which are not been indexed. So technically robots.txt file is quite enough right? Please clarify and guide me if I'm wrong. Thanks
Algorithm Updates | | vtmoz0 -
Are titles on images still important for SEO?
We're doing research on image optimization and wanted to ask the MOZ community if you think having titles on images are still important for SEO if you have descriptive ALT text.
Algorithm Updates | | EvolveCreative0 -
Technical Argument to Prefer non-www to www?
I've been recommending using non-www vs. www as a preferable set up if a client is starting a site from scratch, and there aren't any pre-existing links to consider. I'm wondering if this recommendation still holds? I’ve been looking on the interwebs and I’m seeing far fewer articles arguing for the non-www version. In the two courts, I’m seeing highlighted: Pro www: (ex: www.domain.com) Works better with CDN networks, where a domain needs to be specified (though that argument is 3 years old) Ability to restrict cookies to one hostname (www) or subdomain (info. blog. promo.) if using multiple subdomains IT people generally prefer it Pro non-www (ex: domain.com) If you ever want to support or add https://, you don’t have to support 2 sets of urls/domains Mindset: fewer and fewer people think in terms of typing in www before a site url, the future is heading towards dropping that anyway. Though that is a bit of a cosmetic argument…. Is there a trend going back to www? Is there a technical argument to recommend non-www over www? Thanks!
Algorithm Updates | | Allie_Williams0 -
Ranking under a non-geobased, one word phrase
We have a local client who would like to score under the words "locksmith" and "locksmiths". What is the best way to get him to rank organically and not just in Google Plus Local for those keywords?
Algorithm Updates | | GregWalt0 -
What is the importance of listing score at Getlisted.org regarding higher local 7 pack rankings ?
What is the importance of listing score at Getlisted.org regarding higher local 7 pack rankings ? My listing score is 60% and i am trying to improve it. I am on 2nd page on local map results. So maximum score will help to get place in 7 pack ?
Algorithm Updates | | mnkpso0 -
Too Many Non-Niche-Specific Links?
Something just occurred to me today. I work in-house for an embroidered patch company, but I respond to a lot of HARO queries about Marketing, SEO, SEM, Web Design, ect. So, we have a lot of links from these types of sites. Additionally, I have done guest blogs on these topics because those are what I'm knowledgeable about. We also have links from customers' personal blogs or websites stating they got their patches from us and are happy, blah, blah, blah. On top of that, we hired someone who ended up getting tons of .edu links by spamming blogs. Oy. I'd estimate only about 10% of our links come from embroidery, sewing, screen printing, promotional products, etc types of sites. I guess it's not really known or documented how much weight Google places on niche-specific links--we just assume that it matters, and I'm sure it does. Our rankings are fine now, but I'm looking for some opinions from other SEOs about how much they think this will matter in the future or how much it matters now. Could this hurt us in the future? .
Algorithm Updates | | UnderRugSwept0 -
Blog in Sub Domain or Sub Folder. Pros and Cons
My client wants to show more links on google once someone searches for his company name. Im wondering whats the best way to setup a blog to solve this. Should I create it as blog.website.com.au or website.com.au/blog? What are the pros and cons of each? Thanks heaps guys.
Algorithm Updates | | Uds0 -
Is DMOZ listing important
I have heard a variety of thoughts on the importance of directories such as DMOZ. Any thoughts on this subject from the perspective of google search rankings?
Algorithm Updates | | casper4340