Description tag not showing in the SERPs because page is blocked by Robots, but the page isn't blocked. Any help?
-
While checking some SERP results for a few pages of a site this morning I noticed that some pages were returning this message instead of a description tag,
A description for this result is not avaliable because of this site's robot.s.txt
The odd thing is the page isn't blocked in the Robots.txt. The page is using Yoast SEO Plugin to populate meta data though.
Anyone else had this happen and have a fix?
-
I am having the same issue currently with one of my clients sites. No robots.txt is or was ever in place. I can not find any issues at all that would cause the problem. Was wondering if you every had any resolution to this? Client also uses Yoast.
-
Hi there! Has this issue been resolved? We'd love to have an update, thanks! (Christy)
-
Could the pages have been blocked in robotos.txt in the past? It can take an age for Google to re-index pages a proper after having been blocked previously.
-
Certainly doesn't appear to be any issues there. It's difficult to determine the issue without taking a look closer but its not the robots.txt file and if your site is fully indexed then I can't offer more without seeing the site.
Would you be willing to share the URL?
-
No, it's not on. The site is indexed, just certain description tags aren't.
-
It's pretty standard
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
-
I've seen people with similar issues before and it's been a small but fatal error in the robots.txt file itself. Can you please share it here and I'll advise further if needed.
-
Can you check something for me please?
Log in to wp-admin
Go to Setting then Privacy
Check if “Ask search engines not to index this site.” is set to ON
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Should you do on-page optimization for a page with rel=canonical tag?
If you ad a rel=canonical tag to a page, should you still optimize that page? I'm talking meta description, page title, etc.
On-Page Optimization | | marynau0 -
Strange SERP's descriptions
Hey, when I googled one of our products i came up with this strange result, see attachment. I searched for: kurs praktische psychologie on google germany. These words also come up in the meta description of this page:** Praktische Psychologie** Fernkurs mit professioneller Betreuung. Testen Sie den praxisorientierten Kurs über die Grundlagen der Psychologie 4 Wochen kostenlos. and in the body: _Sie glauben der Mensch lässt sich trotz all seiner Facetten durchschauen, wenn man sich nur Mühe gibt ihn zu verstehen? Da liegen Sie vollkommen richtig! Der Kurs "Praktische Psychologie" vermittelt Ihnen hierfür alle Kenntnisse und Fähigkeiten, sodass Sie schon bald das Mysterium Mensch ergründen. _ Why is Google still showing this description which i obviously don't want to be shown, and why does it state _spring naar (jump to) Kursgeburh _and how can i avoid this? yd1DStW
On-Page Optimization | | NHA_DistanceLearning0 -
How the hell do you get microformat to show up on google serp?
Preface: I implemented Microformat aggregate review (http://data-vocabulary.org/Review-aggregate) for our e-commerce website and included only on the homepage. The vote and count are actually coming from real reviews we are getting from our customers, and in the homepage some reviews are shown prominently and a link points to the full list of all the reviews. Microformat markup is correct, validated in GWT. Have been online for a while (probably a couple of years). Our website: http://www.gomme-auto.it The star rating never showed up. When checking competitors I could see their microformats where not showing up either. But now things changed, if I check one competitor (the market leader www.gommadiretto.it) searching for it with their brand name “gommadiretto” no star rating is showing, but if I search for tires of a specific manufactured like “pneumatici barum” I can see their result in serp is showing the star rating for that specific internal page (the brand page) where they simply put the website overall aggregate review microformat mark up, they actually put it on every page. And that make me scratch my head and start asking myself some questions: is google showing their microformats because they manually awarded them somehow? no other competitor seems to have got the star rating in serp is google showing their microformats because they have so much more reviews than I have? I have around 1700, they have around 11000. is google showing their microformats because their reviews are certified by TrustPilot? is google showing their microformats because they put it in the product page? well of course since I am not putting it there (in the brand page) it's a factor, but isn't it recommended to put the website aggregate reviews microformat only on one page? and shouldn't we show the brand reviews on the brand page? isn't it best practice/recommended to put the website aggregate review microformat only on one page? is google showing their microformats because of some other reasons I can't see? What the hell is google criteria for showing the star rating? Does anyone know?
On-Page Optimization | | max.favilli0 -
Penalty for Changing Home Page Title Tags
Hey Mozzers I'm certain of the answer to this question, however I wanted to get some input from the experts in Moz-land to hopefully provide some additional perspective. I recently disagree with a client's assertion that there is some penalty Google levels for changing the title tags of your home page. Now, I understand changing the title tags can influence serp rankings, however, is anyone aware of some penalty Google levels for simply changing the title tags? Most of what I've read and experienced has people changing them all the time without some phantom penalty. It seems to me a problem of correlation = causality, in that people often attribute a drop to an action that may not have actually been the cause. Anyway, if you have any particular insight on this top I would appreciate it greatly. thanks!
On-Page Optimization | | BrandLabs0 -
Does 'XXX' in Domain get filtered by Google
I have a friend that has xxx in there domain and they are a religious based sex/porn addiction company but they don't show up for the queries that they are optimized against. They have a 12+ year old domain, all good health signs in quality links and press from trusted companies. Google sends them adult traffic, mostly 'trolls' and not the users they are looking for. Has anyone experienced domain word filtering and have a work around or solution? I posted in the Google Webmaster help forums and that community seems a little 'high on their horses' and are trying to hard to be cool. I am not too religious and don't necessarily support the views of the website but just trying to help a friend of a friend with a topic that I have never encountered. here is the url: xxxchurch.com Thanks, Brian
On-Page Optimization | | Add3.com0 -
How do I add a meta description to the individual pages on my cms driven site?
Hello, As you can tell from my question, I'm COMPLETELY new to SEO. SEOMOZ flagged some pages as lacking a meta description. How do I add a meta description to the site? The site has a CMS architecture so I can edit text on the individual pages, but I don't know how to add a meta description, or where on the page it should go. Thanks!
On-Page Optimization | | OTSEO0 -
Should I use a Page Name variable after the ? for a dynamic web page
I'm converting for static to dynamic web pages. It appears that the page name is used for page ranking in the search engines. Will adding a Page Name variable help to increase our SEO. For example aspecialgift.com/subcat.php?PageName=GiftPage&ProductID=ABCDE. Does the page name variable make a difference?
On-Page Optimization | | NCBob0 -
Why isn't SEOMoz using File Extensions (*.html etc) on any of their web page URLs?
...and what is the SEO benefit of this? This video from Matt Cutts suggests using file extentions, except for a directory.
On-Page Optimization | | magicrob0