403 Forbidden Crawl report
-
Hi,
I am getting 403 forbidden crawl report on some of my pages. However the pages are loading fine. Also when asked my web developer told that some times reports show errors when there is nothing wrong. Also will the errors affect the SEO/Ranking etc.
Some of the links:
https://www.medistaff24.co.uk/contact-us/https://www.medistaff24.co.uk/elderly-care-in-evesham-worcestershire/
-
I have a locks business website about locksmith Tampa Florida
we are facing the same issue on the Main page -
A 403 Forbidden error means that the server denied access to the requested page. This can happen for a few reasons, such as:
- The user does not have permission to access the page.
- The page is not published yet.
- There is a misconfiguration on the server.
If you are getting 403 Forbidden errors on your website, it is important to first check that the pages are actually loading fine for users. You can do this by visiting the pages yourself or by using a tool like Google Search Console.
If the pages are loading fine for users, then the errors in the crawl report are likely false positives. This can happen if Googlebot encounters a temporary error when crawling your website. In this case, you can ignore the errors and they should eventually go away.
However, if the pages are not loading fine for users, then the errors in the crawl report are likely real. In this case, you need to fix the underlying issue that is causing the 403 Forbidden errors.
Here are some steps you can take to fix 403 Forbidden errors:
- Check the permissions on the files and folders that contain the pages that are returning 403 Forbidden errors. Make sure that the user account that Googlebot is using has permission to access these files and folders.
- Check the robots.txt file to make sure that Googlebot is not being explicitly denied access to the pages that are returning 403 Forbidden errors.
- Check the server configuration to make sure that there are no misconfigurations that could be causing the 403 Forbidden errors.
If you have tried all of these steps and you are still getting 403 Forbidden errors, then you may need to contact your web hosting provider for assistance.
Will the 403 errors affect the SEO/Ranking
As for whether or not 403 Forbidden errors will affect your SEO/ranking, it depends on a few factors.
-
If the pages that are returning 403 Forbidden errors are important pages for your website, then the errors could potentially have a negative impact on your SEO and ranking.
-
However, if the pages that are returning 403 Forbidden errors are not important pages for your website, then the errors are unlikely to have a significant impact on your SEO and ranking.
It is best to fix 403 Forbidden errors as soon as possible. This will help to ensure that Googlebot can access all of the pages on your website and that your website is crawlable and indexable.
Warm Regards
Rahul Gupta
Suvidit Academy
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Missing Meta description issue reported
Moz says missing meta description, however the meta description exists properly (using yoast plugin) eg of link reported by moz for missing meta description : https://www.basezap.com/reinstall-os-in-vps-using-solusvm-panel/ It is giving same error for many blog posts, as same time, for some articles the issue isn't reported. Although the method for meta description is same for all the posts. Can anyone explain if its a common bug in moz site analysis or I am following something wrong ?
On-Page Optimization | | basezap0 -
How come canonicalized pages are showing in the Duplicate Titles report?
I am currently removing all duplicate titles from my site via title tag changes, 301's, and in some instances, canonical tags. I'm confused about why the Moz report spit out pages with duplicate titles that are canonicalized to other pages. Does Google actually consider these pages as having duplicate titles? Or is Roger Mozbot not intuitive enough to to disregard those pages?
On-Page Optimization | | StevenLevine0 -
What Next after Weekly Crawl Errors Fixed?
Hi MoZ Community! Moz weekly crawl used to report following errors : I have fixed them all over the time. Can somebody give an idea what to do next with the help of Moz or away from Moz to improve my optimization practices. I believe this is just start of the SEO. Or how is it if I focus link building efforts and start fighting for keywords. Also any suggestions about the web? Tanveer | Duplicate Page Content 4XX (Client Error) Title Missing or Empty 5XX (Server Error) Missing Meta Description Tag Duplicate Page Title Title Element Too Long (> 70 Characters) Title Element Too Short Meta Refresh Temporary Redirect |
On-Page Optimization | | Sequelmed0 -
Does this popup get crawled?
Hi, We have a popup on our site that shows examples of different trash cans that can be used for the bags we sell. Here's an example of a page that has the "common cans popup" http://www.plasticplace.com/3-gallon-high-density-6-mic-17x18-clear-trash-bags (This is a screenshot of where to click: http://screencast.com/t/8AvoktAcXtM) Is this content crawled by google? This is how it looks in our source code: view-source:http://www.plasticplace.com/gallon-size/20-30-gallon-trash-bags (start at line 913) Thanks!
On-Page Optimization | | EcomLkwd0 -
Crawl Diagnostics Updates
I have several page types on my sites that I have blocked using the robots.txt file (ex: emailafriend.asp, shoppingcart.asp, login.asp), but they are still showing up in crawl diagnostics as issues (ex: duplicate page content, duplicate title tag, etc). Is there a way to filter these issues or perhaps there is something I'm doing wrong resulting in the issues that are showing up? Ryan
On-Page Optimization | | ryanforrest0 -
Why is SEOMOZ Crawl Diagnostics not in sync with Webmaster Tools
Currently, my Website, according to the Crawl Diagnostics Summary, has 401 'Duplicate Page Title Errors'. But in Google Webmaster Tools, under Óptimization on the Left hand Side Toolbar, if you look up HTML Improvements, there are only 4 'Duplicate Title Tags'. I have two questions re this: A) Do 'Duplicate Page Title Errors' and 'Duplicate Title Tags' have the same meaning' ? , and B) why are there 401 errors located by the former, and just 4 by the latter?
On-Page Optimization | | ABCPS0 -
SEO Moz crawl has 3 missing page title errors when they are clearly there.
My SEO Moz crawl today has highlighted for errors where page titles are empty missing. For example: http://www.musicliveuk.com/live-acts/hire-wedding-entertainment/wedding-entertainment-kent This page clearly has a title as do the other 3. Is it a bug in the system or am I missing something?
On-Page Optimization | | SamCUK0 -
Should a crawl ever take more than 7 days?
I signed up to the 30 day trial last Saturday, however, as of yet, the crawl diagnostics page still says 'First crawl in progress'. Is this normal? Many thanks.
On-Page Optimization | | danzspas0