Crawl report shows that it gets 4xx errors for pages that work fine. Why?
-
On the crawl report it has all these "Critical Crawler Issues". They all say "4xx Error", yet when i click on the link from the crawler report, it goes to a perfectly functioning page, not a 404 page or anything. If i click in it actually says it's a 403 error. It's all for pages generated by the IDX solution for our real estate website.
Is Moz broken or am i missing something?
Here are a couple examples:
<dl class="crawl-page-details-list">
<dd class="crawl-page-details-list-emphasis">https://teamvivi.com/homes-for-sale-map-search/</dd>
<dd class="crawl-page-details-list-emphasis">
<dl class="crawl-page-details-list">
<dd class="crawl-page-details-list-emphasis">https://teamvivi.com/email-alerts/</dd>
</dl>
</dd>
</dl>
-
There are definitely other optimizations you can do, and Visual Composer may not be the biggest slowdown. I just noticed when I viewed the source code that it was inserting a lot of separate CSS files and so it may be contributing some. Other optimizations like going through PageSpeed Insights' recommendations may get you farther.
But any themes and plugins you use on a WP site, those resources are loaded across the whole site - even on pages they're not used on. So in a lot of cases, selecting a premade theme or having one built from scratch can make your site a lot faster than using page builders. Basically it's a tradeoff: do you want to pay someone to code a theme specifically for you and do the heavy lifting up front (or make design compromises and use a well-coded prebuilt theme), so the code that renders to visitors is lightweight; or do you want to just go wysiwyg on the admin side, so the code that renders to visitors is bogged down but you don't have to hire a developer?
-
Ugh, that's not good news since my entire site is built with Visual Composer basically.... Interestingly though, those pages are not even using Visual Composer. Those are pages that are generated by the IDX solution (iHomeFinder by Optima Express).
-
A 403 error means the crawler isn't being allowed to access that page. You should check robots.txt and if nothing is blocking there, check with your host to see if they can help identify why Roger is being blocked from those particular pages.
Related question: https://moz.com/community/q/403-error-code-but-page-shows-no-error
On a side note, those pages took a really long time to load for me, so I'd also look into site speed. Visual Composer for one is adding all sorts of different stylesheets and bogging things down.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Working with longtail
How do I work with 'longTails' in Moz? how do I get correct keyword and tails do I write 'keyword and tail' or could I write 'tail and keyword' - I think of order how many words could be used? Three: 'Keyword/Head' and 'modifier' and 'tail'? what do competition do? could I set longTail phrase/words as normal keywords to see ranking in compartion to competition? etc.
Moz Bar | | astridhelene0 -
Issues with Crawl Test and SSL Certificate
So I have having issues with the Crawl Test being able to crawl my site accurately due to what the tool is saying is a "SSL Certificate Error" (804 : HTTPS (SSL) error encountered when requesting page.) Only thing is that I have no warnings about this SSL issue in Search Console and when I check the SSL on https://www.sslshopper.com it comes back just fine. Anybody know why this might be happening or have encountered this issue before?
Moz Bar | | DRSearchEngOpt0 -
Q&A Question showing as answered when it is not
Yeh, that question at http://moz.com/community/q/onpage-grader-says-site-unreachable is not actually answered even though someone has marked it as such. Don't know how to mark it as not. Just annoying, as it may prevent someone else chime in with new information now I have updated it with some more info myself as I am just trying to get this resolved.
Moz Bar | | TheWebMastercom0 -
URL not returning a page successfully
I am trying to use the on page grader however it is not working with my website. The url is: http://www.britishhardwoods.co.uk/ Can anyone help?
Moz Bar | | British_Hardwoods0 -
Why isn't seo moz properly crawling my site?
In my campaign results, only 2 pages have been crawled, when there are many more. Also, when I do the on-page evaluation for my homepage and the main keyword, I get a grade of F, with a ton of errors that my page actually does not have. It's as if SEO moz is having trouble crawling through my site. Any ideas on this?
Moz Bar | | diplomajim0 -
Moz reporting reliable?
I have been working with our MIS department on addressing our errors on duplicate content and titles caused by parameter URLs. MIS insists that they have solved the problem with canonical tags, which are in place. They said they were getting warnings from Google and Bing, but that after they put the canonical tags in place, those went away. They are questioning the Moz reports, suggesting that I instead rely on SEO Toolit by Microsoft. (As an aside, we are using SharePoint 2010, crossing our fingers for an upgrade to 2013, which presumably will make a lot of the issues we’re having go away). So my questions are: 1) Why are these Moz reports reporting all of these errors that have supposedly been rectified (in 2011)? Do I disregard the duplicate content/title errors on the Moz report and defer to SEO Toolkit, as MIS suggests?
Moz Bar | | SSFCU0 -
Duplicate Page Content Report on MOZ
Hi, I am just wondering as to the accuracy of this report - does it pick up all the duplicate on page content? Or is there a limit? We have an ecommerce store with a lot of copied and pasted descriptions - just wondering if there is a limit on how much the moz crawler picks up? In other words, once we fix what MOZ has detected, will there be more detected because it is limited to display say up to 200?? Hope you understand what I mean. Thanks
Moz Bar | | bjs20100