What does the blocking_google property in the CSV export mean, and what to do about it?
-
The CSV export for Crawl Diagnostics contains a column named "blocked_google". It states a blocking date/time but doesn't occur on all our webpages, not even on all pages of the same type / structure.
There are no other flags on these records that would explain a blocking of Google; all other agents are not flagged, and our robots.txt doesn't contain any blocks either. The only flag the records have in common is "Page Title > 70 characters". Of course, I could just assume this is the reason for the "blocking_google", but is it?
What evaluation makes the crawler fill in this property, and how to handle/solve it's occurrence?
-
that page seem fine, and it also indexed by google, so I'm not sure whats the story with that. Might be best to contact seomoz support (help@moz.com I think)
-
Thank you again for your response.
The following link forwards to one of the affected pages: http://bit.ly/1b3IVYB
I'm downloading Screeming Frog right now and give it a try, thank you for the advice.
-
can you give an example of one of the pages the is "blocked_google"
Btw try screeming frog ( you can do 500 pages for free), it should pick up the same error and might explain why.
-
Thank you for your response.
Our CMS generates the following meta-tags on the affected pages:
Pragma is for cache control, content-type and google verification are clear. P: is Pinterest Social media, the rest is standard again. I searched the source of the page for "robots" as well, but no results.
-
check that those pages don't have some like:
meta name="robots" content="NOINDEX,NOFOLLOW" />
in the source code
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to arrange taxonomies when many mean the same thing?
Hello 🙂 I'm trying to figure out the category/taxonomy structure for my website which will be selling "Colored Contact Lenses" I'm a bit confused because, there are several search queries which sort of mean the same thing, for example "Halloween Contacts" are sort of the same thing as "Colored Contacts" people searching for Colored Contacts may potentially be looking for "Natural" styles, however many are looking for crazy styles, aka "Halloween Contacts" or "Crazy Contacts" Crazy contacts and halloween contacts, being the exact same thing just different choice of words from the searcher. So I'm trying to think of what to do for categories/link structure... I believe i should start with a primary category .com/colored-contacts/ then .com/colored-contacts/halloween-contacts/ But what about crazy contacts? Should I keep going, .com/colored-contacts/crazy-contacts/ which will have the exact same products listed? I'm kind if going crazy thinking about this lol, any thoughts and advice would be highly appreciated. Thank you!
Technical SEO | | abuntlysupport0 -
Schema Markup for property listings (estate agent)
Hello, I've been looking online for some help with this. An estate agent has a page of properties for sale. Is it possible to mark these individual properties up and if so would they appear as rich snippets in the SERPS - never seen anything like this for properties for sale so just wondered,
Technical SEO | | AL123al1 -
Should a sub domain be a separate property in the Search Console?
We're launching a blog on a sub-domain of a corp site (blog.corpsite.com). We already have corpsite.com set up in the Search Console. Should I set up a separate property for this sub-domain in the Search Console (WMT) in order to manage it? Is it necessary? Thanks, JM
Technical SEO | | HeroDesignStudio0 -
Redirect Without Passing Old Page Properties
Is there a way to redirect one page to another, e.g. test.com/ to test.com/home, without passing link juice or any other associated properties of the latter to the former?
Technical SEO | | NTGproducts0 -
Automatically write Mass 301 redirects for csv
Hi Guys Does anyone know if there is away to write say 30 x 301 redirects in one go? I have a list from a client with old links and new links and I want to do it all at once. Any suggestions would be appreciate?
Technical SEO | | Cocoonfxmedia0 -
If my home page never shows up in SERPS but other pages do, does that mean Google is penalizing me?
So my website I do local SEO for, xyz.com is finally getting better on some keywords (Thanks SEOMOZ) But only pages that are like this xyz.com/better_widgets_ or xyz.com/mousetrap_removals Is Google penalizing me possibly for some duplicate content websites I have out there (working on, I know I know it is bad)...
Technical SEO | | greenhornet770 -
Google previews meanings
I have noticed that when I do a site:mysite.com search and all my indexed pages come up, that when I hover over the arrows and bring up the previews some of the pages have things in a red rectangle and some of the pages even have zig zag-like tears/perforations running through them. What do these signify?
Technical SEO | | VictorVC0 -
Does PR actual mean anything?
My website is really ranking well, even product pages have a PR of 4. I ran the keyword analysis tool for the product page in question (which has a PR of 4) with the targeted keyword for the page which is currently ranking 8th (not so good) the keywords analysis tool give me some data back with the page authority being 1 and it also mentions that it has 0 page link root domains, however I know this is not true. I expected the page authority in seomoz to be higher than 1 due to it having a PR of 4, so how valuable is PR? does it even matter? Another thing I noticed is that the website above my listing have PR of 1 and 2. Looking forward to some feedback
Technical SEO | | Paul780