Crawl report shows that it gets 4xx errors for pages that work fine. Why?
-
On the crawl report it has all these "Critical Crawler Issues". They all say "4xx Error", yet when i click on the link from the crawler report, it goes to a perfectly functioning page, not a 404 page or anything. If i click in it actually says it's a 403 error. It's all for pages generated by the IDX solution for our real estate website.
Is Moz broken or am i missing something?
Here are a couple examples:
<dl class="crawl-page-details-list">
<dd class="crawl-page-details-list-emphasis">https://teamvivi.com/homes-for-sale-map-search/</dd>
<dd class="crawl-page-details-list-emphasis">
<dl class="crawl-page-details-list">
<dd class="crawl-page-details-list-emphasis">https://teamvivi.com/email-alerts/</dd>
</dl>
</dd>
</dl>
-
There are definitely other optimizations you can do, and Visual Composer may not be the biggest slowdown. I just noticed when I viewed the source code that it was inserting a lot of separate CSS files and so it may be contributing some. Other optimizations like going through PageSpeed Insights' recommendations may get you farther.
But any themes and plugins you use on a WP site, those resources are loaded across the whole site - even on pages they're not used on. So in a lot of cases, selecting a premade theme or having one built from scratch can make your site a lot faster than using page builders. Basically it's a tradeoff: do you want to pay someone to code a theme specifically for you and do the heavy lifting up front (or make design compromises and use a well-coded prebuilt theme), so the code that renders to visitors is lightweight; or do you want to just go wysiwyg on the admin side, so the code that renders to visitors is bogged down but you don't have to hire a developer?
-
Ugh, that's not good news since my entire site is built with Visual Composer basically.... Interestingly though, those pages are not even using Visual Composer. Those are pages that are generated by the IDX solution (iHomeFinder by Optima Express).
-
A 403 error means the crawler isn't being allowed to access that page. You should check robots.txt and if nothing is blocking there, check with your host to see if they can help identify why Roger is being blocked from those particular pages.
Related question: https://moz.com/community/q/403-error-code-but-page-shows-no-error
On a side note, those pages took a really long time to load for me, so I'd also look into site speed. Visual Composer for one is adding all sorts of different stylesheets and bogging things down.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to export to csv all top pages links in link explorer?
When i press export to csv it does not offer to choose how many rows but exports to file only 500 rows. But there is more than 3000. How to export all rows? Thanks
Moz Bar | | AndrisZigurs0 -
Blocked Resource in Google Index. SSL certificate blocking 718 pages seen in Google Search Console.
My google search console indicates that my SSL certificate is blocking Googlebot. I was wondering if the blocking of my SSL certificate to the GoogleBot is causing any issues. I I'm not sure if this was only blocked recently by Volusion (my host) as a means of accommodating my ssl certificate not being able to address the various url versions of my site, or is this just commonplace and not really harmful to my indexing. I tested one of these "blocked" urls in the robots.txt tester and it showed that the Googlebot was allowed. Could it be just the SSL certificate at the bottom of the page is blocked? Thanks
Moz Bar | | mrkingsley0 -
Site crawl only shows homepage
Hi everyone, A client of us has a quite new website with a lot of URLs. (Google Search Console indicates around 5300.) However, when I execute a site crawl with screaming frog, or a crawl test in MOZ, it only shows me one URL, the homepage. Does somebody have an idea why the other pages of the website are not showing up? Thanks,
Moz Bar | | WeAreDigital_BE
Jens0 -
Re On-Page Grader
One of the pages I'm trying to optimise is achieving an 'A' grade, however all the ticks are black not green as I've seen on other page grade. Why is this? Help much appreciated. Thanks
Moz Bar | | seoman100 -
My crawl report only shows 1 link
Hello, I've tried a crawl for the site www.doctify.co.uk and it's only returned 1 link in the report which is the homepage. Do you know what the issue could be? Thanks, Nina
Moz Bar | | Global_Blue0 -
Why is the exact same URL being seen as duplicate and showing an error in my SEO reports
Well, I am still having duplicate page issues. I have a question about one of the errors SEO is giving me when I download a crawl report. I am going to attach a screen shot of part of the report so you can see for yourself, along with explaining it here. SEO shows the list of URL's that it crawled in the report. In this(see attachment) portion of the report it has 321 results for the exact same URL. It also says all of these exact same URL's have received a 404 error. What I want to know is how does it make 321 results for the same URL? And with this error that I don't see when I look at the page? 0hkRDST
Moz Bar | | JoshMaxAmps0 -
Why does it show (in Moz) that we don't have any meta descriptions on our site when we do?
We have over 1,330 pages that say we are "Missing Meta Description Tag" when I spot check all of them have meta descriptions? Can you please explain to me why Moz is picking up that we do not have meta descriptions when we do. Our website http://www.betheboss.ca Please help. I would like a accurate measure of meta descriptions that are missing.
Moz Bar | | BeTheBoss0