Soft 404
-
Hey forum,
My site is a Price Comparison site. Lately I've been getting some "Soft 404" errors with the Webmaster tool. I'll try to explain the steps causing it:
1. There's a valid link to a product
2. At some point the product is temporary out of stock or unavailable.
3. Google crawls this product page, getting a valid page with a message explaining this product is unavailable at this time.
4. Google see this page for few different products and (I assume) figures it's a none existing page and so it's a soft 404.
The possible solutions I see are:
1. Return real 404, I'm not a fan of this solution, because these links will very likely be valid again when the product is back in stock.
2. Live with some "soft 404" errors in the webmaster tool.
3. Find another way to explain to Google that it's not a real 404. This sounds great but I'm not sure how this can be done.
Any thoughts which would be the best method? Or maybe another solution I haven't thought of?
Thank you.
-
You're welcome. I hope it all works out as you expect.
-
Without getting too technical, currently the user isn't really being redirected at all, because it's a dynamic page with the results, which can be any number, in this case, 0.
I will take your advice and indeed create a custom "out of stock" page that will be returned for all these cases. Maybe it will be clearer to Google. Obviously these won't rank well, but I'm fine with it, as long as I don't get ranking penalty for the entire site, for none existing pages. Under the circumstances I guess this is the best option.
Thank you very Daniel, you've been very helpful.
-
This is where it goes a bit over my head as a programer, which I'm not, but we would need to dive into the code a bit. I'm not sure I can be of help with details, but from what I'm understanding is as follows.
I understand that if a product is in stock, it shows the page, if the product is not in stock, rather than that pages information changing to say it is no longer in stock, you get redirected to or the page changes to a new page that simply says it can't find what you are looking for.
If I'm right, you need to change the code so when a product is not found or no longer in stock, instead of pointing to this dead page returning zero, or instead of just having that page deleted (in turn being 404), have the page change content or redirect to another page saying it is no longer in stock.
I'm not sure I'm clear here, but what I'm saying is, have it direct to a page you created yourself that says you are temporarily out of stock, rather than the program automatically generating a 404 page.
I hope this helps send you in the right direction, otherwise I'm no programer so can't give you exact instructions, but maybe someone who knows e-commerce programming can help here.
-
Thanks again Daniel.
I'm a web developer too
What would a "proper page" be though? Keep in mind at this point I don't know anything about this product. Each general "out of stock" page will be the same for each product making it a "soft 404" probably, unless I make it a real 404, which will solve the "soft 404" but will create a new problem, 404 pages for some previously valid URLs.
Both are not good, I'm aware of it, however, we are talking less than 0.05% of the site's pages.
-
OK, from what I can see in your example link and what you just confirmed in your last note, the problem is in the design of the database search.
If a product is out of stock, instead of just saying that particular product is out of stock, it comes back with a 0 search results returned. It's basically searching for something and takes you to a page saying that doesn't exist. That would totally explain why you are getting soft 404 errors because you are basically searching for a page that doesn't exist.
You need your web developer to fix this so it takes you to a proper page with some sort of information rather than what is currently a nice looking soft 404 page.
-
Thanks for the reply Daniel. Here's an example link: link
Basically anything with a wrong number will return this page. I know it's not a great page for this purpose, just a regular product page with 0 items and a message. It's just rare enough that we didn't spend too much on it. How rare? According to the Webmaster tool, out of the last 296k pages crawled, 70 were found.
Basically at this point, I have no information on this item, all I know is that someone got here so it's probably a valid product code, which is true unless someone just edited the URL manually.
-
I'm not an expert in this area, but it sounds like a coding issue. Somehow when Google looks at the page it triggers that error. If I understand correctly, when you are out of stock, the system automatically generates a message that says it is out of stock. What does that page look like? Maybe if you post an example of that webpage it could be helpful.
I'm thinking you will need to modify that out of stock template so it includes other information. Whether it be as Kaushal recommended, or even just plain text saying anything. Maybe "Sorry we are currently out of stock, please check back later or contact us for an ETA". Having other information on the page should show to Google it is still an active page with content on it. One way or another, the problem sounds like it's with that out of stock template the database is using.
Maybe I'm way off, but if you link to an example page, that would probably help.
-
Thanks for the reply Kaushal. We actually don't have a system currently that lists similar products and considering we have over 20 million products, it's also not a minor thing to implement. Anyway I'm not sure I like the way other sites try to push products that aren't really what you were looking for.
-
Can't you show message "Product is out of stock for now" message. And show related product below with "You might be interested in below product" message.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to Handle a Soft 404 error to an admin page in WordPress
I'm seeing this error on Google Webmaster Console: | URL: | http://www.awlwildlife.com/wp-admin/admin-ajax.php | | | Error details | Linked from | | |
Intermediate & Advanced SEO | | aj613
| Last crawled: 11/15/16First detected: 11/15/16 The target URL doesn't exist, but your server is not returning a 404 (file not found) error. Learn more Your server returns a code other than 404 or 410 for a non-existent page (or redirecting users to another page, such as the homepage, instead of returning a 404). This creates a poor experience for searchers and search engines. More information about "soft 404" errors | Any ideas what I should do about it? Thanks!0 -
404's - Do they impact search ranking/how do we get rid of them?
Hi, We recently ran the Moz website crawl report and saw a number of 404 pages from our site come back. These were returned as "high priority" issues to fix. My question is, how do 404's impact search ranking? From what Google support tells me, 404's are "normal" and not a big deal to fix, but if they are "high priority" shouldn't we be doing something to remove them? Also, if I do want to remove the pages, how would I go about doing so? Is it enough to go into Webmaster tools and list it as a link no to crawl anymore or do we need to do work from the website development side as well? Here are a couple of examples that came back..these are articles that were previously posted but we decided to close out: http://loyalty360.org/loyalty-management/september-2011/let-me-guessyour-loyalty-program-isnt-working http://loyalty360.org/resources/article/mark-johnson-speaks-at-motivation-show Thanks!
Intermediate & Advanced SEO | | carlystemmer0 -
Images Returning 404 Error Codes. 301 Redirects?
We're working with a site that has gone through a lot of changes over the years - ownership, complete site redesigns, different platforms, etc. - and we are finding that there are both a lot of pages and individual images that are returning 404 error codes in the Moz crawls. We're doing 301 redirects for the pages, but what would the best course of action be for the images? The images obviously don't exist on the site anymore and are therefore returning the 404 error codes. Should we do a 301 redirect to another similar image that is on the site now or redirect the images to an actual page? Or is there another solution that I'm not considering (besides doing nothing)? We'll go through the site to make sure that there aren't any pages within the site that are still linking to those images, which is probably where the 404 errors are coming from. Based on feedback below it sounds like once we do that, leaving them alone is a good option.
Intermediate & Advanced SEO | | garrettkite0 -
Webmaster tools 404
Hey, I'm getting a soft 404 error on a webpage that has content and is deferentially not a 404. We've redirect a load of urls to the web page. The url has parameters which was used before the redirect but are no longer used on by the new url, these parameters have been carried over in the redirect. Is this whats causing the soft 404 error or is there another problem that may need addressing? Also a canonical has been set on the webpage. Thanks, Luke.
Intermediate & Advanced SEO | | NoisyLittleMonkey1 -
How to Destroy Old 404 Pages
Hello Mozzers, So I just purchased a new domain and to my surprise it has a domain authority of 13 right out of the box (what luck!). I needed to investigate. To make a long story short the domain used to be home to a music blog that had hundreds of pages which of course are all missing now. I have about 400 pages on my hands that are resulting in a 404. How or what is the best method for eliminating these pages. Does deleting the Crawl Errors in Google Webmaster Tools do anything? Thanks
Intermediate & Advanced SEO | | TheOceanAgency0 -
Wordpress No 404
Hello, My issue is that in wordpress 404 does not seem to be working properly. An example of this is: sitename.com/category/catname loads the files in that category but I can also type sitename.com/category/asdasfaasd/catname and it still goes to the posts in that category and does not 404. I can replace the misc text with anything and it does not 404. My worry is that this can be used to exploit duplicate content. I've looked at a couple of other sites and they do the same. I'm using Yoast as my SEO plugin and my theme is elogix from themeforest. I've tried disabling all plugins, cloudflare and changing theme and the same issue exists. If anyone can help it would be extremely appreciated.
Intermediate & Advanced SEO | | LukeHutchinson0 -
Status Code: 404 Errors. How to fix them.
Hi, I have a question about the "4xx Staus Code" errors appearing in the Analysis Tool provided by SEOmoz. They are indicated as the worst errors for your site and must be fixed. I get this message from the good people at SEOmoz: "4xx status codes are shown when the client requests a page that cannot be accessed. This is usually the result of a bad or broken link." Ok, my question is the following. How do I fix them? Those pages are shown as "404" pages on my site...isn't that enough? How can fix the "4xx status code" errors indicated by SEOmoz? Thank you very much for your help. Sal
Intermediate & Advanced SEO | | salvyy0 -
Have you ever seen this 404 error: 'www.mysite.com/Cached' in GWT?
Google webmaster tools just started showing some strange pages under "not found" crawl errors. www.mysite.com/Cached www.mysite.com/item-na... <--- with the three dots, INSTEAD of www.mysite.com/item-name/ I have just 301'd them for now, but is this a sign of a technical issue? The site is php/sql and I'm doing the URL rewrites/301s etc in .htaccess. Thanks! -Dan EDIT: Also, wanted to add, there is no 'linked to' page.
Intermediate & Advanced SEO | | evolvingSEO0