Adding non-important folders to disallow in robots.txt file
-
Hi all,
If we have many non-important folders like /category/ in blog.....these will multiply the links. These are strictly for users who access very rarely but not for bots. Can we add such to disallow list in robots to stop link juice passing from them, so internal linking will me minimised to an extent. Can we add any such paths or pages in disallow list? Is this going to work pure technical or any penalty?
Thanks,
Satish
-
But as per the current SEO buzz, internal nofollow leads of waste of link juice and we cannot preserve it. Moreover some suggests not to use nofollow internally.
-
This is a great resource for all things robots.txt related: [http://www.robotstxt.org/robotstxt.html](http://www.robotstxt.org/robotstxt.html)
-
Hi,
Yes you can block in robots.txt. You can also use rel="nofollow" if you don't want to pass link juice.
[No Link Juice](https://www.example.com) Hope this helps. Thanks
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
The importance of meta keywords?
Hello, Is adding meta keywords still worth doing nowadays? I have been reading and hearing some different opinions about it. For a ' beginner ' in this field it is hard to find a definite answer to this questions.. Thank you for reading(and answering) my question!
Algorithm Updates | | EPPD0 -
Google AMP (accelerated mobile pages), can it be used for non-Google news and Ecommerce Websites?
Mozzers, I've been doing a lot of research on Google's new Accelerated Mobile Pages (AMP) https://moz.com/blog/accelerated-mobile-pages-whiteboard-friday. From what I'm seeing, these AMP version websites are only for Google News-worthy websites such as New York Times, Cosmopolitan, and the BuzzFeeds of the world. But what about Ecommerce websites like Ebay or Amazon? Will AMP versions of "scotch tape" via OfficeDepot work in the SERP's on non-Google News cards?
Algorithm Updates | | Shawn1240 -
Its the 21st April, and my non responsive page is still ranking the same ?
Hi, As you know the new algorithm is due today, can anybody confirm why my site wouldn't appear to be affected as yet? Cheers
Algorithm Updates | | CFCU0 -
Google Unable to Access Robots.txt
We haven't made any changes to the robots.txt file and suddenly Google claims they can no longer access the file. The site has been up and active for well over a year now. What are my next steps? I have included a screenshot of the top half of the file. See anything wrong? D3H5tgE.png
Algorithm Updates | | rhoadesjohn0 -
URL Names not so important in future?
I read somewhere (hard to say where with all the information about SEO and google!) that in the future, Google will put less importance on the URL name for ranking purposes. Any thoughts?
Algorithm Updates | | Llanero0 -
No longer ranking for non local local terms
Anyone seen this lately; I have a client who is in the food catering business and for the seo we target a lot of local keywords (event catering Hampshire, for example). In the past couple of weeks search engine traffic to the website seems to have dropped by about 60%. However, rankings do not seem to have dropped. What I have noticed is that up until a couple of months back, the client would be ranking first page in the Google local and also have a listing in the 'normal' serps. It appears that the non local pages have vanished. Checking a couple of their competitors and it seems the same there. This has led me to start to believe that Google are now only giving a local position or a normal position on the first page and not both, as previously. The non local pages are sitll listed but seem to have dropped way back to the 4th or 5th page when previously they would have been first page. It would of course help if the client were to give me access to the webmaster tools!!! Hate it when client's only give you half the information you need and then expect you to tell them what's up!! Anyone seem this? Thanks, Carl
Algorithm Updates | | ccgale0 -
Does google index non-public pages ie. members logged in page
hi, I was trying to locate resources on the topics regarding how much the google bot indexes in order to qualify a 'good' site on their engine. For example, our site has many pages that are associated with logged in users and not available to the public until they acquire a login username and password. Although those pages show up in google analytics, they should not be made public in the google index which is what happens. In light of Google trying to qualify a site according to how 'engaged' a user is on the site, I would feel that the activities on those member pages are very important. Can anyone offer suggestions on how Google treats those pages since we are planning to do further SEO optimization of those pages. Thanks
Algorithm Updates | | jumpdates0 -
How is important domain age now?
Just as topic states, how important do you think domain age is? Do you think getting old domain for the new website will do any difference? Lets say website A used to sell apples... went out of business after 5 years of business. If I would get that domain and will star selling apples again can I expect some extra boost because of the age? Cheers
Algorithm Updates | | DiamondJewelryEmpire0