Crawl report shows that it gets 4xx errors for pages that work fine. Why?
-
On the crawl report it has all these "Critical Crawler Issues". They all say "4xx Error", yet when i click on the link from the crawler report, it goes to a perfectly functioning page, not a 404 page or anything. If i click in it actually says it's a 403 error. It's all for pages generated by the IDX solution for our real estate website.
Is Moz broken or am i missing something?
Here are a couple examples:
<dl class="crawl-page-details-list">
<dd class="crawl-page-details-list-emphasis">https://teamvivi.com/homes-for-sale-map-search/</dd>
<dd class="crawl-page-details-list-emphasis">
<dl class="crawl-page-details-list">
<dd class="crawl-page-details-list-emphasis">https://teamvivi.com/email-alerts/</dd>
</dl>
</dd>
</dl>
-
There are definitely other optimizations you can do, and Visual Composer may not be the biggest slowdown. I just noticed when I viewed the source code that it was inserting a lot of separate CSS files and so it may be contributing some. Other optimizations like going through PageSpeed Insights' recommendations may get you farther.
But any themes and plugins you use on a WP site, those resources are loaded across the whole site - even on pages they're not used on. So in a lot of cases, selecting a premade theme or having one built from scratch can make your site a lot faster than using page builders. Basically it's a tradeoff: do you want to pay someone to code a theme specifically for you and do the heavy lifting up front (or make design compromises and use a well-coded prebuilt theme), so the code that renders to visitors is lightweight; or do you want to just go wysiwyg on the admin side, so the code that renders to visitors is bogged down but you don't have to hire a developer?
-
Ugh, that's not good news since my entire site is built with Visual Composer basically.... Interestingly though, those pages are not even using Visual Composer. Those are pages that are generated by the IDX solution (iHomeFinder by Optima Express).
-
A 403 error means the crawler isn't being allowed to access that page. You should check robots.txt and if nothing is blocking there, check with your host to see if they can help identify why Roger is being blocked from those particular pages.
Related question: https://moz.com/community/q/403-error-code-but-page-shows-no-error
On a side note, those pages took a really long time to load for me, so I'd also look into site speed. Visual Composer for one is adding all sorts of different stylesheets and bogging things down.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Cant figture out why On-Page Grader is not recognizing the heading tag text
Hi all, I'm using the On-Page Grader tool to optimize some of our pages: https://analytics.moz.com/pro/research/page-grader?keyword=Russian Immigration Lawyers in Sacramento&url=https%3A%2F%2Fwww.russianlawyers.us%2Fus%2Fcalifornia%2Fsacramento-immigration One of the suggestions is "Optimal Use of Keywords in Header Tags". They keyword is "Russian Immigration Lawyers in Sacramento" and we do have it in an tag on the page (located in the right sidebar). The tool doesnt seem to catch that though. Can someone help me please? Thanks
Moz Bar | | heritageweb1 -
Keyword Explorer shows wrong data
Hi all, Trying to figure out what is going on with the keyword explorer. All searches are made in the EN-US region. Example keyword: app localization
Moz Bar | | Fred.Visnevsky
Moz shows me that volume is 0-10, which is Wrong. Actual volumes are in thousands per month. Another keyword - translation service
Moz shows the volume as 2480 when actual volumes are in tens of thousands. I can give many more examples like this - what is going on? NZGzX2p.png vzIwMoe.png1 -
Moz Bar doesn't show any data and keeps asking me to log in when actually I'm logged in.
Hi all, I've been using Moz Bar for years. It ran well until about three weeks ago. It suddenly failed to show the DA and PA of sites that I open after I log in. And it keeps asking me to log in when I did. I tried to uninstall the Mozbar extension and reinstalled it several times. Nothing worked. I also tried to uninstall Chrome and clear the cookies, still, nothing changed. Did anyone experience this? How do you solve it and make it run on the track? Any information will be appreciated. [admin edited support category]
Moz Bar | | Bennie22339 -
Is there anyway to track on-page grader grades for a site?
As opposed to going through the process of inputting the urls and keywords every couple of weeks, is there a way of Moz to send the scores for those keywords and the domain to which the url belongs?
Moz Bar | | DigitalGuru0 -
Duplicate content reported for totally different pages
Hi, The Moz report is showing just over 21,500 duplicate page issues on our site. This is more or less every page we have. However when I look at the pages it says are duplicates they are totally different (it could for example report that a news page for 2009 is the same as a product page just added which has no relation when you read the content or view the page). What sort of thing could it be picking up as duplicate content? I assume it must be something in the HTML for the site rather than the actual page content as there is no cross over at all on the pages highlighted. The only issue I can currently identify is that the menu for the mobile version of the site has a huge number of internal links which I will cut down. If the tools purely look at HTML content this could be seen as duplicate but shouldn't it be clever enough to realise what is content and what is site structure? Thanks,
Moz Bar | | TW-Steve0 -
Crawl Diagnostics: Exlude known errors and others that have been detected by mistake? New moz analytics feature?
I'm curious if the new moz analytics will have the feature (filter) to exclude known errors from the crwal diagnostics. For example, the attached screenshot shows the URL as 404 Error, but it works fine: http://en.steag.com.br/references/owners-engineering-services-gas-treatment-ogx.php To maintain a better overview which errors can't be solved (so I just would like to mark them as "don't take this URL into account...") I will not try to fix them again next time. On the other hand I have hundreds of errors generated by forums or by the cms that I can not resolve on my own. Also these kind of crawl errors I would like to filter away and categorize like "errors to see later with a specialist". Will this come with the new moz analytics? Anyway is there a list that shows which new features will still be implemented? knPGBZA.png?1
Moz Bar | | inlinear0 -
What happened to moz Crawl Test? Is it moved in the redesign?
Love the new design of moz.com! And the mentions tool is terrific. However, I use the Crawl test a ton and cannot find where to access it now.
Moz Bar | | jessential0 -
Where is the Crawl Tool we had before Research?
Hello, I can't seem to find the crawl tool for other domains that aren't in our campaigns. We've lost it 😞 Thanks, Romeo.
Moz Bar | | RomeoMadrid1