Files blocked in robot.txt and seo
-
I use joomla and I have blocked the following in my robots.txt is there anything that is bad for seo ?
User-agent: *
Disallow: /administrator/
Disallow: /cache/
Disallow: /components/
Disallow: /images/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Disallow: /xmlrpc/
Disallow: /mailto:myemail@myemail.com/
Disallow: /javascript:void(0)
Disallow: /.pdf
-
What you have there is just blocking rootdomain.com/javascript:void(0). Googlebot can execute and index JavaScript; you should not block it without a good reason. I'd let it read the JavaScript and see the submenus.
-
Thank you and is blocking javascript bad ? ( I was thinking about submenus )
-
If you don't want pages in those Disallowed directories to be indexed, then you're doing fine. These pages won't be able to be crawled, so, they won't be likely to appear in search results for any search engines.
The last three entries look fishy to me. I'd need to know what types of URLs you're trying to block to fix them. For the last one, if you're looking to block all pdfs on your site, the syntax would be Disallow: /*.pdf.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Where do we focus from an SEO perspective?
I run a digital business development consulting company. Our core has always been centered around consulting with client to develop strategy and then working with a set of vendors in a variety of different services types to implement the strategy. I'm struggling right now to determine the best approach for our own SEO. Our website is http://phase2solutions.net. What suggestions would you have on the approach here? Feel free to share your service as well as the tactical end is something we are looking to outsource. Thank you.
Intermediate & Advanced SEO | | phase2solutions0 -
FIle Names
HI Guys, Would it make a difference if I named a URL 2014-ford-fiesta.html or 2014+ford+fiesta.html Thanks!
Intermediate & Advanced SEO | | oomdomarketing0 -
Template Files .tpl versus .html files
We sell a large selection of Insulation Products use template files (.tpl) to collect up-to-date information from a server side database file that contains some 2,500 line items. When an HTML (.html) file is requested on the Internet, the 'example.tpl' file is accessed, the latest product and and pricing information is accessed, then presented to the viewer as 'example.html' My question: Can the use of .tpl files negatively impact Search Engine acceptance?
Intermediate & Advanced SEO | | Collie0 -
Video SEO
Hello All! I'm wondering about the best way to link build and carry on my video trend. I love to create video's with all of my articles as I feel it adds an extra element to just boring old text! The problem is that my current 25 links from Youtube are all NoFollow. This didn't originally bother me, but it's starting too. Is there a couple of websites that I could upload my article/ video to and gain a link from in a similar manner? Come to think of it, is this a good SEO tactic to use?
Intermediate & Advanced SEO | | Paul_Tovey0 -
Read More & SEO
I have just had my site redesigned. The site was designed with only important facts bullets at the top of the page and all other information is below in the read more section that expands when clicked. I am wondering if I need to have this information in the read more section visible to the customer or if having the majority of the text in the read more is OK? and how it will effect rankings having it this way? I have had spots #1 &2 on Google for my keywords- until the site was redesigned...wondering if this was part of the reason. I have moved some of the text up to be visible on some of the pages - but it makes the site look cramped - and competes with the ease of use the site design Any insight on this is appreciated.
Intermediate & Advanced SEO | | Cheri110 -
Mobile SEO
Hi there, My website when searching via mobile is now showing the mobile version of the site in SERPs, well for quite sometime now to be honest, anyway the ranking in mobile are no different to what they are on desktop, is there actually anything I can do to influence my mobile SERPs? 9 times out of 10 it's desktop websites that are ranking about me in mobile search. Any help would be appreciated.
Intermediate & Advanced SEO | | Paul780 -
Is this Negative SEO?
Hello Everyone, I have just spent the past 9 months designing, engineering, and manufacturing our first product. We just opened our web store and started selling product. http://miveu.com. I have spent zero time doing any kind of SEO. We haven't even put up a sitemap yet or any redirects. I'm just now starting to take a look at things. As soon as I start digging, I find that it appears that someone is at least attempting to do some kind of negative SEO against us. It seems to have started about a month ago. Check this out. https://www.google.com/search?q=miveu&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-beta#q=miveu&hl=en&client=firefox-beta&hs=bo2&tbo=1&rls=org.mozilla:en-US:official&prmd=imvns&source=lnt&tbs=qdr:d&sa=X&psj=1&ei=AGgBUJfJNK650QHW8YW-Bw&ved=0CE0QpwUoAg&bav=on.2,or.r_gc.r_pw.r_qf.,cf.osb&fp=335379d2f3ac2208&biw=993&bih=637 At first I was thinking this isn't so good, but it seems they are just trying to build crap content about our keywords and make it relevant to us. After taking a closer look, I'm thinking maybe this isn't all bad. They have targeted all of our exiting YouTube videos and created new videos that use all of our keywords, titles, people, etc in an effort to make our existing videos irrelevant. They have have also done the same thing with articles that were written about us, awards we have won as well as started negative campaigns about us and people who have said good things about us. Here are my thoughts. While the content is really crappy, it seems like they are actually building keyword relevance to us and our products. They have all the right keywords, the content is just crappy. "There is no such thing as bad press". I don't know if anyone has ever said this before, but I'm going to refer to their effort as "White-Hate SEO" because it doesn't appear to be a real dark effort. Am I missing something here, am I way off base? My bigger worry is that their campaign may include some much darker efforts that I just haven't found yet. I'm pretty sure I know who is responsible for this. They have made it clear that they really do hate us. Frankly, I'm not interested in retaliation, I just want to get my own house in order with some good old-school whit-hat SEO. I'm really curious to hear your thoughts on this. Thanks!
Intermediate & Advanced SEO | | dmac
David0