Description tag not showing in the SERPs because page is blocked by Robots, but the page isn't blocked. Any help?
-
While checking some SERP results for a few pages of a site this morning I noticed that some pages were returning this message instead of a description tag,
A description for this result is not avaliable because of this site's robot.s.txt
The odd thing is the page isn't blocked in the Robots.txt. The page is using Yoast SEO Plugin to populate meta data though.
Anyone else had this happen and have a fix?
-
I am having the same issue currently with one of my clients sites. No robots.txt is or was ever in place. I can not find any issues at all that would cause the problem. Was wondering if you every had any resolution to this? Client also uses Yoast.
-
Hi there! Has this issue been resolved? We'd love to have an update, thanks! (Christy)
-
Could the pages have been blocked in robotos.txt in the past? It can take an age for Google to re-index pages a proper after having been blocked previously.
-
Certainly doesn't appear to be any issues there. It's difficult to determine the issue without taking a look closer but its not the robots.txt file and if your site is fully indexed then I can't offer more without seeing the site.
Would you be willing to share the URL?
-
No, it's not on. The site is indexed, just certain description tags aren't.
-
It's pretty standard
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
-
I've seen people with similar issues before and it's been a small but fatal error in the robots.txt file itself. Can you please share it here and I'll advise further if needed.
-
Can you check something for me please?
Log in to wp-admin
Go to Setting then Privacy
Check if “Ask search engines not to index this site.” is set to ON
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Should I change our main category pages to product listing pages?
With the thought of improving user experience, as well as rankings in Google, I'm considering changing our main category pages to product listing pages (with sub-categories remaining, still). These main category pages are very standard and don't link to any informational content, such as buyers guides, etc. What's driven this is the latest Google core update. I've noticed our main competitor (who we were out-ranking before... but not now) now uses this approach. I can see the benefit from a user perspective, i.e. less clicks to reach products. What's the pros/cons from an SEO point of view, please? Could the potential duplication of content be an issue? For context, we have about 2,000 products and website is on Magento 2.
On-Page Optimization | | alifeofjoy1 -
My website have h1 tags , but still crawlers can't find them?
crawlers can't crawl my meta description and h1 tags even when they are present.
On-Page Optimization | | Green_Beauty0 -
Page grader says we are keyword stuffing but we arn't. Page source shows different story.
Hi community! We have just run a page grader for the keyword 'LED Bulbs' on whichledlight.com and it comes up that we are keyword stuffing! However, a brief look at the source for the homepage and there's only 6 times that LED Bulbs pops up. We do have the non plural version of the word 'LED Bulb' on the page 27 times.. do we think that would contribute to the keyword stuffing? Thanks!!
On-Page Optimization | | TrueluxGroup0 -
Contact pages coming up for keywords above landing pages
I have two examples of contact pages coming up over designated landing pages Keyword: Nickel Alloys for www.neonickel.com Keyword: Artificial Grass for www.artificialgrass4u.co.uk Is there anyway I can stop this happening?
On-Page Optimization | | icansee0 -
Do I need a robots meta tag on the homepage of my site?
Is it recommended to include on the homepage of your site site? I would like Google to index and follow my site. I am using WordPress and noticed my homepage is not including this meta tag, therefore wondering if I should include it?
On-Page Optimization | | asc760 -
Google SERPS showing wrong page.
I am new to SEO and trying to rank for keyword 'corporate entertainment' and my site is currently at 26. However google is showing the homepage http://www.musicliveuk.com in SERPS as opposed to my optomised page http://www.musicliveuk.com/home/corporate-entertainment. Any ideas why it is choosing so show the home page as the most relevant result?
On-Page Optimization | | SamCUK0 -
SERPs Showing H1s Instead of Title Tags?
Hi, I'm noticing two strange things in search results recently. Often I find that if I search for a client's company name, I see just the company name in SERPs where the title tag would normally be displayed. Examples: 'aci northwest' 'lanz heating' As strange as that is, I'm tempted to assume this is just Google's way of "getting smarter" and showing more relevant results (though I'm not sure exactly where it's pulling from). But it gets stranger. For the first example, 'aci northwest', when search that key phrase on Bing/Yahoo!, etc. I'm not only not seeing the title tag where it would normally be, but I'm seeing the H1 in it's place: "When your projects demand more, demand ACI." Any idea what's happening here? Thanks in advance!
On-Page Optimization | | VTDesignWorks0 -
Meta Description Tags and Rankings
Hi there, I have a lot of pages set up on my site but most have no content. If I add the correct meta description tags to those pages, will that help rank for the root domain? I am slowly getting the content added for each page but wanted to see if I could boost rankings in the meantime. http://www.petmedicalcenter.com Example: most of pages under "Services" are blank. Thanks for the help!
On-Page Optimization | | PMC-3120870