Description tag not showing in the SERPs because page is blocked by Robots, but the page isn't blocked. Any help?
-
While checking some SERP results for a few pages of a site this morning I noticed that some pages were returning this message instead of a description tag,
A description for this result is not avaliable because of this site's robot.s.txt
The odd thing is the page isn't blocked in the Robots.txt. The page is using Yoast SEO Plugin to populate meta data though.
Anyone else had this happen and have a fix?
-
I am having the same issue currently with one of my clients sites. No robots.txt is or was ever in place. I can not find any issues at all that would cause the problem. Was wondering if you every had any resolution to this? Client also uses Yoast.
-
Hi there! Has this issue been resolved? We'd love to have an update, thanks! (Christy)
-
Could the pages have been blocked in robotos.txt in the past? It can take an age for Google to re-index pages a proper after having been blocked previously.
-
Certainly doesn't appear to be any issues there. It's difficult to determine the issue without taking a look closer but its not the robots.txt file and if your site is fully indexed then I can't offer more without seeing the site.
Would you be willing to share the URL?
-
No, it's not on. The site is indexed, just certain description tags aren't.
-
It's pretty standard
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
-
I've seen people with similar issues before and it's been a small but fatal error in the robots.txt file itself. Can you please share it here and I'll advise further if needed.
-
Can you check something for me please?
Log in to wp-admin
Go to Setting then Privacy
Check if “Ask search engines not to index this site.” is set to ON
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Which Is More Important? Building a web page for customer reviews or a careers page?
Hello, I am wondering which would be more important to have on a website a customer review page or a careers page? And as far an SEO advantage which is more important and why?
On-Page Optimization | | Nicks1230 -
Page Layout Updates and Mobile Pages with Ads
I have been trying to do some research on the Page Layout Algorithm and Top Heavy Ads and much of what I read does not mention about mobile pages as apposed to desktop. I am curious if the Page Layout updates can be effected by mobile pages as well and if there is any good articles on this subject. Also is this Algorithm been incorporated into its regular algorithm or do we still have to wait for refreshes to see the impact? Cesar
On-Page Optimization | | cbielich0 -
Google Treating these URL's as diff, but they are same. please help
Google is treating, below URL's as two different URL's when they are same. How to solve this. Please help. Case 1:/2570/Venture-Capital-and-Capital-Markets/2570/venture-capital-and-capital-marketsCase 2: /xxx/Java-Programming//xxx/Java-ProgrammingPlease help, how to solve this. Thanks in advance
On-Page Optimization | | AnkammaRao0 -
Blank Title and Description Tags
Hi guys. Some times web platforms that I do work on have pages that I normally do not optimize. They more often than not have blank meta titles and meta descriptions. If I put titles and descriptions on these pages, no matter how minor, would it help the site as a whole to rank better? Thanks!
On-Page Optimization | | oomdomarketing0 -
Short URL's vs Optimised URL's
Howdy Mozzers! What are your thoughts on short URL's vs Optimised URL's. For example if a website currently sells wood furniture and wants to target the keyword "Wood Furniture For Sale", which URL would be preferable: Short URL: www.domain.com/wood-furniture Optimised URL: www.domain.com/wood-furniture-for-sale The website also uses facet navigation and selected attributes are added in a fixed order sequence after the category. For example if Cane is selected as wood type: Short URL: www.domain.com/wood-furniture/Cane Optimised URL: www.domain.com/wood-furniture-for-sale/Cane Which one do you prefer (between the short URL and optimised URL) and why? Cheers! MozAddict
On-Page Optimization | | MozAddict0 -
Why Isn't Google Authorship Showing My Picture?
I have several clients and the Google Authorship images used display in the search results for all of them. About a month ago all of the images disappeared, however it still displays "by <name>, indicating that Google Authorship is working -- it just doesn't show the image (see screenshots). The image follows the guidelines, and we've got the rel author tag in place, with a link back to Google. </name> When I use the Google Structured Data Testing Tool it shows that authorship is properly functioning. I'm completely stumped. Does anyone have any ideas why this may not be working? Here's two examples of the sites with Authorship not working properly (screenshots below): criminalattorneylongislandny.com
On-Page Optimization | | socialfirestarter
https://dl.dropboxusercontent.com/u/3786946/Screen Shot 2014-01-03 at 12.53.10 PM.png
https://dl.dropboxusercontent.com/u/3786946/Screen Shot 2014-01-03 at 12.44.12 PM.png attorneytonyadderley.com https://dl.dropboxusercontent.com/u/3786946/Screen Shot 2014-01-03 at 12.52.36 PM.png
https://dl.dropboxusercontent.com/u/3786946/Screen Shot 2014-01-03 at 12.52.52 PM.png0 -
Using phrases like 'NO 1' or 'Best' int he title tag
Hi All, Quick question - is it illegal, against any rule etc to use phrases such as 'The No 1 rest of the title tag | Brand Name' on a site?
On-Page Optimization | | Webrevolve0 -
Why is the seomoz showing it crawled 3 pages when i only have 2 pages?
I had seomoz crawl my site. I only have 2 pages. The site url is www.autoinsurancefremontca.com.
On-Page Optimization | | Greenpeak0