403s: Are There Instances Where 403's Are Common & Acceptable?
-
Hey All,
Both MOZ & Webmaster tools have identified 403 errors on an editorial site I work with (using Drupal CMS). I looked into the errors and the pages triggering the 403 are all articles in draft status that are not being indexed. If I am not logged into our drupal and I try to access an article in draft status I get the 403 forbidden error.
Are these 403's typical for an editorial site where editors may be trying to access an article in draft status while they are not logged in? Webmaster tools is showing roughly 350 pages with the 'Access Denied' 403 status.
Are these harmful to rank?
Thanks!
-
Hi guys and girls,
With regards to this, ss there any problem for SEO that you can see with banning spam refers through Htaccess?
So in these instances when a spam bots comes to the site, we throw a "Forbidden You don't have permission to access / on this server.", so basically a 403 error?
We're considering this as a more permanent solution to using filters in GA.
What do you think?
Thanks,
Gill.
-
Thanks Nicolas & Ruth. I realized the reason the pages are triggering errors is because there are published pages linking to those posts in draft. I imagine those draft posts were live at some point and then put back into draft.
Im guessing if I kill all the links to those draft posts that will fix the issue.
-
I agree that it's probably not a huge problem, but still something to clean up if you can - it would be best if crawlers weren't trying to access these pages.
-
If Moz and Webmaster Tools are showing the 403 error, it means that they are able to crawl to the URLs that are returning the 403 - so somewhere on your site or on the web, pages that are accessible by bots and crawlers are linking to these pages that don't exist yet. Having a bunch of errors on your site can impact Google's ability to crawl it well, which can impact your rankings, so it's best to get those cleaned up. In Webmaster Tools you should be able to click on the pages and see which pages are linking to them, so you can remove those links; you can do the same using a tool like Screaming Frog if you'd prefer. Good luck!
-
Hello,
No problem with these URLs, Drupal returns a 403 correctly because crawlers try to get draft content. Google and other search engines will not penalized you because of that : you can think of cart URLs or account URLs for ecommerce websites that may returns 403 the same way.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Large site with content silo's - best practice for deep indexing silo content
Thanks in advance for any advice/links/discussion. This honestly might be a scenario where we need to do some A/B testing. We have a massive (5 Million) content silo that is the basis for our long tail search strategy. Organic search traffic hits our individual "product" pages and we've divided our silo with a parent category & then secondarily with a field (so we can cross link to other content silo's using the same parent/field categorizations). We don't anticipate, nor expect to have top level category pages receive organic traffic - most people are searching for the individual/specific product (long tail). We're not trying to rank or get traffic for searches of all products in "category X" and others are competing and spending a lot in that area (head). The intent/purpose of the site structure/taxonomy is to more easily enable bots/crawlers to get deeper into our content silos. We've built the page for humans, but included link structure/taxonomy to assist crawlers. So here's my question on best practices. How to handle categories with 1,000+ pages/pagination. With our most popular product categories, there might be 100,000's products in one category. My top level hub page for a category looks like www.mysite/categoryA and the page build is showing 50 products and then pagination from 1-1000+. Currently we're using rel=next for pagination and for pages like www.mysite/categoryA?page=6 we make it reference itself as canonical (not the first/top page www.mysite/categoryA). Our goal is deep crawl/indexation of our silo. I use ScreamingFrog and SEOMoz campaign crawl to sample (site takes a week+ to fully crawl) and with each of these tools it "looks" like crawlers have gotten a bit "bogged down" with large categories with tons of pagination. For example rather than crawl multiple categories or fields to get to multiple product pages, some bots will hit all 1,000 (rel=next) pages of a single category. I don't want to waste crawl budget going through 1,000 pages of a single category, versus discovering/crawling more categories. I can't seem to find a consensus as to how to approach the issue. I can't have a page that lists "all" - there's just too much, so we're going to need pagination. I'm not worried about category pagination pages cannibalizing traffic as I don't expect any (should I make pages 2-1,000) noindex and canonically reference the main/first page in the category?). Should I worry about crawlers going deep in pagination among 1 category versus getting to more top level categories? Thanks!
Moz Pro | | DrewProZ1 -
What's the best way to keep track of keyword rankings
Here's the deal. I keep track of my keyword rankings with the help of Rank Tracker from seopowersuite.com for the most part. I ran it on a daily basis and my keyword was not in top 100 for a few months. Moz.com panel shows pretty much the same (not in top 50) for the same months. That said, if I check that keyword ranking in my Google Webmaster Tools (avg. position) it says that its position (ranking?) was on average: 49, 7, 7, 8 (for the last four months). So, I'm not sure how it's even possible? How come Rank Tracker and Moz don't see any rankings and Google gives me sorta decent avg. positions at the same time. I assume that avg. postion means that same as avg. ranking, right? I'm not sure what I'm missing here.
Moz Pro | | VinceWicks0 -
What's my best strategy for Duplicate Content if only www pages are indexed?
The MOZ crawl report for my site shows duplicate content with both www and non-www pages on the site. (Only the www are indexed by Google, however.) Do I still need to use a 301 redirect - even if the non-www are not indexed? Is rel=canonical less preferable, as usual? Facts: the site is built using asp.net the homepage has multiple versions which use 'meta refresh' tags to point to 'default.asp'. most links already point to www Current Strategy: set the preferred domain to 'www' in Google's Webmaster Tools. set the Wordpress blog (which sits in a /blog subdirectory) with rel="canonical" to point to the www version. Ask programmer to add 301 redirects from the non-www pages to the www pages. Ask programmer to use 301 redirects as opposed to meta refresh tags & point all homepage versions to www.site.org. Does this strategy make the most sense? (Especially considering the non-indexed but existent non-www pages.) Thanks!!
Moz Pro | | kimmiedawn0 -
Why don't i see a domain mozrank or moztrust?
Why don't i see a domain mozrank or moztrust? The compeitor's numbers work, but not my own site. Thanks a lot!
Moz Pro | | ivordg0 -
SEOmoz report vs. Google's Algo
Hello, I got an SEOmoz Report for one of our clients and the report is showing these pages and many more others as duplicate page content. Thing is the page content is not duplicate however there is very little data differentiating the contents. My question is does Google see the following pages contents as duplicate? because seomoz does. http://dallastxlofts.com/blog/2012/06/using-a-loft-for-commercial-or-office-space.html/img_9632/ http://dallastxlofts.com/blog/2012/08/newly-renovated-in-victory-park.html/3-2/ http://dallastxlofts.com/blog/2012/08/pedestrian-friendly-uptown-west-village.html/attachment/18/ http://dallastxlofts.com/blog/2012/06/using-a-loft-for-commercial-or-office-space.html/img_4322/ http://dallastxlofts.com/blog/2012/08/historic-deep-ellum-lofts.html/2012-08-18-11-24-30/ http://dallastxlofts.com/blog/2012/08/pedestrian-friendly-uptown-west-village.html/attachment/13/ http://dallastxlofts.com/blog/2012/06/using-a-loft-for-commercial-or-office-space.html/842-4/
Moz Pro | | Bryan_Loconto0 -
I've tried everything, and my blog still falling
Hello everyone! 🙂 I'm almost desperate, and trying to find a solution to one of my blogs. Below is it URL: http://www.xboxplus.net/ It has more than 3 years, and even so I get just around 700-1000 visitors a day. I have already applied several SEO techniques, tried several SEO plugins, tried to work with keywords, etc, but nothing changes. I see several other sites and blogs of the same niche (games), with much less content (I have more than 3800 articles, in 3 years), practicing plagiarism, stealing content, etc, and with much more visitors and revenue. I have never done nothing wrong. Never stole content. I always worked honestly, and always tried to write articles with "something more". I really don't know what happens with XboxPlus.net . And, how can, for example, Seomoz helps me, here? I would be very grateful for any help. 😄
Moz Pro | | Andarilho0 -
Conflicting Data with Open Site Explorer & SEO Moz Toolbar
Hi there, Why is my SEOmoz toolbar showing me higher linking root domains than open site explorer? For example, for this site: http://thisisouryear.com/, the linking root domains in SEOMOZ show 1,015 and in open site explorer it says it has 35. I have noticed this for other sites as well. Which one is right? And why are they different?
Moz Pro | | qlkasdjfw1 -
Why won't scheduled crawl of my site begin?
I currently have a campaign running on SEOMoz for over a month. It has been showing that a crawl was scheduled to start on 12/21. Now it's 12/23 and there has not been a new crawl, and it still says scheduled for 12/21.. Anyone know why this is happening or how to fix it? Thanks
Moz Pro | | Prime850