How to get a list of robots.txt file

[csfarnsworth]

This is my site.

http://muslim-academy.com/

Its in wordpress.I just want to know is there any way I can get the list of blocked URL by Robots.txt

In Google Webmaster its not showing up.Just giving the number of blocked URL's.

Any plugin or Software to extract the list of blocked URL's.

[simon_realbuzz]

If you use Bing Webmaster tools you can see a complete list all URLs blocked by robots.txt. You can export the file and then filter.

Just go to Reports & Data > Crawl Information within your Bing webmaster account. I am not aware of this feature being in Google webmaster tools. Hope this helps.

[csfarnsworth]

simon_realbuzz buddy If I use this /classifieds/ it means I am blocking all URL starting with it.I want to get a list of all blocked URL's of site.

Example

http://muslim-academy.com/classifieds/

How many URL's associated with this classified are blocked by my robots.txt.

[simon_realbuzz]

I'm sorry I don't follow. If you go to that URL you will see the list of blocked URLs as I've pasted below.

User-agent: *

Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /forum/viewtopic.php?p=
Disallow: /forum/viewtopic.php?=&p=
Disallow: /forum/viewtopic.php?t=
Disallow: /forum/viewtopic.php?start=
Disallow: /forum/&view=previousDisallow: /forum/&view=next
Disallow: /forum/&sid=
Disallow: /forum/&p=
Disallow: /forum/&sd=a
Disallow: /forum/&start=0
Disallow: /forum/memberlist.php
Disallow: /forum/posting.php
Disallow: /classifieds/
Disallow: /forum/index.php
Disallow: /forum/ucp
Disallow: /http://muslim-academy.com/الا�%A..
Disallow: /http://muslim-academy.com/особенн%D
Disallow: /http://muslim-academy.com/ислам-ка%
Disallow: /http://muslim-academy.com/classifieds/ads/Disallow: /http://muslim-academy.com/значени%D..
Disallow: /.ifieds/
Disallow: /.ifieds/ads/
Disallow: /forum/alternatelogin/al_tw_connect.php?authentication=1
Disallow: /forum/search.php

[csfarnsworth]

simon_realbuzz I need a list of blocked URL's not the robots.txt file path.

[simon_realbuzz]

You can view your robots file simply by appending /robots.txt to your site URL. Just put the following http://muslim-academy.com/robots.txt and you'll be able to view your robots file.