Why are these results being showed as blocked by robots.txt?
-
If you perform this search, you'll see all m. results are blocked by robots.txt: http://goo.gl/PRrlI, but when I reviewed the robots.txt file: http://goo.gl/Hly28, I didn't see anything specifying to block crawlers from these pages.
Any ideas why these are showing as blocked?
-
Hi,
Your robots.txt file is very .. steroid healthy. It has his own universe
Are you 100% sure all of the entries are legit and clean ?
First thing I would do is to check Web M;aster Tools for the mobile subdomain. If you don't have it yet, that will be a good place to start - to verify the m subdomain.
Once in WeB Master Tools - you can debug this in no time.
Cheers.
-
but, even when i search from my mobile device, I get the same results (that m. is blocked)
-
I can't submit because I haven't claimed m. in GWT
-
If you haven't already done so, I recommend testing your robots.txt file against one of your mobile pages (such as m.healthline.com/treatments) in Google Webmaster Tools. You can do this by logging into GWT, then click Health, then Blocked URLs.
If you have already tested it in GWT, can you let us know what the results said?
-
Another good article from the community
-
So after a little it or research as I never ever came past this before as all the site we do are responsive, I found this
http://support.google.com/webmasters/bin/answer.py?hl=en&answer=72462
It seems Google wont index a website that they think is a mobile website within the main serp, and vice verse ...
Hope that helps, cause it had me puzzled
Regards
John
-
Which directory are you storing your mobile website files within ...
-
Oh, sorry, on further investigation I see its just your mobile site that are being blocked ...
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Default Robots.txt in WordPress - Should i change it??
I have a WordPress site as using theme Genesis i am using default robots.txt. that has a line Allow: /wp-admin/admin-ajax.php, is it okay or any problem. Should i change it?
Intermediate & Advanced SEO | | rootwaysinc0 -
Site: search showing funny results
Hi When i do a site: search on my domain the very last result it returns is a URL which is listed as my domain but does not exist on my website. When clicked it redirects to a really spammy page. If im not being clear just let me know, quite hard to explain the situation! Any thoughts to get rid of this?
Intermediate & Advanced SEO | | TheZenAgency0 -
Used Alternate Domain for Print Material But not Showing up in SERPs
Used an alternate domain name to send print advertising traffic to so we could measure effectiveness. The domain does not have any content on it and only forwards to our actual domain. The issue is neither domain shows up when people search the alternate domain name without .com. The question is, will putting up content under that domain, including meta data, and submitting the site to Google as well as running fetch as Google make the alternate domain name to show up... it's an extremely unique domain name and there's basically zero competition for it.
Intermediate & Advanced SEO | | Dom4410 -
Title in serch result
Hi, Im the webmaster of http://www.canexel.es and we are having some problems with the title of the home page. this is my title tag: <title></span><span>Casas de madera mucho más que casas prefabricadas - Canexel</span><span class="webkit-html-tag"></title> This what apear in SERPS in keywords like casas de madera (google esp): Canexel: Casas de madera mucho más que casas prefabricada...
Intermediate & Advanced SEO | | Canexel0 -
Recently created site indexed; no backlinks showing?
I launched a website for a client in mid-March. The site is already indexed, I have built quite a few links to it (links are also indexed), and ranks well for some targeted keywords. However, when I try to check backlinks to the site with Open Site Explorer, it comes back with "No Data Available For This URL". Is this something I should be worried about or merely a case of 'recency' of page creation'? I know it says that it can take 45-60 days for a site to be included in Linkscape but I'm approaching the 60 days mark and still nothing.
Intermediate & Advanced SEO | | Igor-Avidon0 -
Some things I have noticed SEO which showed a positive
Hi, Just a few small things I have noticed which has made a difference in ranking, thought I would share, small things but every little helps. Looks like more content on a page the better the ranking, in a test I have done this is what I found: page with 0 content - Google page 11 page with 250 content - Google page 5 page with 500 content - Google page 2 page with 1000 content - Google page 1, position 3 Looks like Google might count the words on a page (like you can do in Microsoft word) and then apply a score against it. Tweets and likes (78) showed a jump from page 1, position 8, to page 1, position 1 (this was the only form of link building and no changes made apart from adding the share plugin). Kind of makes me think if your starting a new site or page then add 750 - 1000 words of good content (tutorial or whatever) with a social sharing tool and let this run will give you a better chance of ranking when you start to introduce products and services.
Intermediate & Advanced SEO | | activitysuper0 -
Why specify robots instead of googlebot for a Panda affected site?
Daniweb is the poster child for sites that have recovered from Panda. I know one strategy she mentioned was de-indexing all of her tagged content, fo rexample: http://www.daniweb.com/tags/database Why do you think more Panda affected sites specifying 'googlebot' rather than 'robots' to capture traffic from Bing & Yahoo?
Intermediate & Advanced SEO | | nicole.healthline0 -
If your analytics show you something like this, what is your next strategy?
What is your thought if your site's analytic is showing you something like that graph? is it "DAMN!!! it is not supposed to be like that, the X are supposed to be greater then Y by at least two or three" And what is your next strategy? is it "okay, i need to put on backburner for my link building kungfu now immidiately...." Please share your thought.. because i dont know if i should be happy or not looking at something like this showing up on my analytics... Please do share your opinion GoodBad.png
Intermediate & Advanced SEO | | IKT0