Critical factor Accessible to engine
-
Hello , i don't understand "Accesible to Engine" - critical factor - that indicate:
<dl>
<dt>Crawl status</dt>
<dd>Status Code: 200
meta-robots: None
meta-refresh: 0; URL=/shop/searchresult.seam
X-Robots: None</dd><dt>Explanation</dt>
<dd>Pages that can't be crawled or indexed have no opportunity to rank in the results. Before tweaking keyword targeting or leveraging other optimization techniques, it's essential to make sure this page is accessible.</dd>
<dt>Recommendation</dt>
<dd>Ensure the URL returns the HTTP code 200 and is not blocked with robots.txt, meta robots or x-robots protocol (and does not meta refresh to another URL)</dd>
<dt>My data</dt>
<dd>This is the content of my index and home page:</dd>
<dd>and this is my file robots content:</dd>
<dd>User-agent: *
Disallow: /shop/debug.seam
Disallow: /bhimg/
Disallow:/shop/cart/
Disallow:/shop/G10/
Disallow:/shop/help/
Disallow:/shop/img/
Disallow:/shop/jQueryUI/
Disallow:/shop/js/
Disallow:/shop/layout/
Disallow:/shop/myShop/
Disallow:/shop/newUser/
Disallow:/shop/shop/
Disallow:/shop/staticPages/
Disallow:/shop/stylesheet/
Disallow:/shop/error.seam
Disallow:/shop/login.seam
Disallow:/shop/login.seam
Disallow:/shop/test/
Disallow:/shop/utility/
Disallow:/shop/zoomifyer/</dd><dd>Tks for any reply.</dd>
</dl>
-
I think there's a very good chance that adding the Meta Robot instructions will resolve the problem. It's a pretty easy fix so I'd definitely try it out, and if it doesn't work, continue to troubleshoot.
Notice the last few lines of the report:
<dt>Recommendation</dt>
<dt>Ensure the URL returns the HTTP code 200 and is not blocked with robots.txt, meta robots or x-robots protocol (and does not meta refresh to another URL)</dt>
Though you're not technically "blocking" the meta robots, there's no instruction for them to index or follow the page. Also if the meta refresh is to another URL, that is an issue. well.
-
yes , my index.html page have 0 second refresh.
/shop/searchresult.seam have all the characteristics in the like Anthony said .
Do you think that add in the index.html page can resolve the problem?
-
Hi,
I think the reason you're getting this error is that your entire site is essentially "blocked" from agents.
It doesn't look like you've disallowed the path in the report via robots.txt, so I think it's an issue with the section of your document not containing instructions for robots to index and follow the site.
The perfect goes like this:
<title>Title of Page | Free iPad when you buy Cheap Viagra Online Pharmacy</title>
Apple Tablet save money on the best online pharmacy price of Viagra erectile dysfunction ED treatment pill capsule sample. " />
apple steve jobs ed erectile dysfunction best price on viagra pills pharmacy cheap discounts cialis pill Viagra Pill Viagre Viagrah capusle Canadian Viagra save money ipad ipad2 new ipad free best website for viagra" />
Kidding!
I think it's just the last line you'll need to add that let's robots know to index and follow the page:
You might possibly want to use the entire URL in the first line...
content="0; URL=http://yoursite.com//shop/searchresult.seam"
But I'm not positive about that. Like Red Clay said, the 0 second refresh could definitely be the problem too.
Hope this helps!
Anthony
-
Hi - perhaps it's an issue with your index page having a 0 second refresh?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Our crawler was not able to access the robots.txt file on your site.
Good morning, Yesterday, Moz gave me an error that is wasn't able to find our robots.txt file. However, this is a new occurrence, we've used Moz and its crawling ability many times prior; not sure why the error is happening now. I validated that the redirects and our robots page are operational and nothing is disallowing Roger in our robots.txt. Any advice or guidance would be much appreciated. https://www.agrisupply.com/robots.txt Thank you for your time. -Danny
Moz Pro | | Danny_Gallagher0 -
What search engines does SEOMoz pull the SERP data from on the keyword analysis report?
I did a Google search and I noticed that some of the rankings that pulled up did not match the SEOmoz top 1-10 competitors. I was sure not to include personal results. I was completely signed out of my Google account. Another one of the SEO tools showed the same result as when I did the Google search, completely different from SEOmoz's report. I am curious to know where the data comes from, so I can accurately compare/ contrast the varying results.
Moz Pro | | JMFieldMarketing0 -
HTC access 301 redirect rules regarding pagination and striped category base (wp)
I am an admin of a wordpress.org blog and I used to use "Yoast All in one SEO" plugin. While I was using this plugin it stripped the category base from my blog post URL's. With yoast all in one seo: Site.com/topic/subtpoic/page/#
Moz Pro | | notgwenevere
Without yoast all in one seo: Site.com/category/topic/subtopic/page/# Now, that I have switched to another plugin, I am trying to manage the page crawl errors which are tremendous somewhere around 1800, mostly due to pagination. Rather than redirecting each URL individually I would like to develop HTC access 301 redirects rules. However all instructions on how to create these HTC access 301 redirect rules are regarding the suffix rather than the category base. So my question is, can HTC access 301 redirects rules work to fix this problem? Including pagination? And if so, what would this particular HTC access 301 redirect look like? Especially regarding pagination? And do I really have to write a 301 redirect for each pagination page?0 -
Why are the rankings of my keywords different to rankings from other programmes such as 'Access my Lan' and 'Firefly'? Does SEOMoz count 'Google Places and Maps' in their rank count? Im thinking this could explain the difference
Why are the rankings of my keywords different to rankings from other programmes such as 'Access my Lan' and 'Firefly'? Does SEOMoz count 'Google Places and Maps' in their rank count? Im thinking this could explain the difference
Moz Pro | | john_Digino0 -
How to rank each page correctly in the search engines
Hello everyone, I am new to SEOmoz and SEO in general. I am trying to wrap my head around everything and one of the issues I am having trouble grasping is how each individual page on our website plays into ranking for certain keywords. I will explain in more detail below: 1.) We are not a blog, we have a pretty static website. 2.) We can add as many pages to our website as needed (for SEO purposes) 3.) Our site is fairly small, about 25 pages on the website. Now with that information above, here are our main questions & concerns: 1.) What is the best way to rank in the search engines for 50 of our best converting keywords with only 25 pages on our website? 2.) We have 2-3 competitors that rank in positions 1-3 for about 30 of our keywords we are trying to rank for. But no matter what you type in, for example, "cars" "buy cars" "buy a car online" "truck prices" etc, the results that the search engines display our their homepages. Not the other pages on their websites that actually rank for each one of those individual keywords. Is this normal? That is something that we would like for our rankings to do if we have any control over it. 3.) Should each page try to rank for a unique individual keyword? For example, when using the SEOmoz On-page Optimization tool, should I try ranking 2 pages for "buy cars online" or just 1 page? Say my homepage has an "A" grade for the keyword, "buy cars online" but so does my second page on my website. Are these pages essentially competing with each other? Or will the search engines pick their favorite page and display the one they like the best? Any help is greatly appreciated and I look forward to getting this cleared up. Thanks
Moz Pro | | threebiz0 -
A competator ranked higer thank me although all my seomoz factors are significantly higher.
Hey, I'm new to seoMoz and this is my first question (so far it's been great!). Short summery, I got a website in a specific nitch in google IL, my website is 2 years old.
Moz Pro | | Ace.biz
All my opensiteexplorer params are far higher than my competitor. On the exact keyword I'm ranked #3, wikipedia ranked #2, he's ranked #1. Cant figure out why is that. I've tried copying his links profile, linking from same site he does. Had partial success but my links profile is far larger in terms of quality and content. My page is graded "A" by seomoz tools. Attached my OpenSiteExplorer screenshot. I'm wondering what are your thoughts on that. Regards,
Oleg. factors2.png0 -
How to get rid of the message "Search Engine blocked by robots.txt"
During the Crawl Diagnostics of my website,I got a message Search Engine blocked by robots.txt under Most common errors & warnings.Please let me know the procedure by which the SEOmoz PRO Crawler can completely crawl my website?Awaiting your reply at the earliest. Regards, Prashakth Kamath
Moz Pro | | 1prashakth0