Soft 404
-
Hey forum,
My site is a Price Comparison site. Lately I've been getting some "Soft 404" errors with the Webmaster tool. I'll try to explain the steps causing it:
1. There's a valid link to a product
2. At some point the product is temporary out of stock or unavailable.
3. Google crawls this product page, getting a valid page with a message explaining this product is unavailable at this time.
4. Google see this page for few different products and (I assume) figures it's a none existing page and so it's a soft 404.
The possible solutions I see are:
1. Return real 404, I'm not a fan of this solution, because these links will very likely be valid again when the product is back in stock.
2. Live with some "soft 404" errors in the webmaster tool.
3. Find another way to explain to Google that it's not a real 404. This sounds great but I'm not sure how this can be done.
Any thoughts which would be the best method? Or maybe another solution I haven't thought of?
Thank you.
-
You're welcome. I hope it all works out as you expect.
-
Without getting too technical, currently the user isn't really being redirected at all, because it's a dynamic page with the results, which can be any number, in this case, 0.
I will take your advice and indeed create a custom "out of stock" page that will be returned for all these cases. Maybe it will be clearer to Google. Obviously these won't rank well, but I'm fine with it, as long as I don't get ranking penalty for the entire site, for none existing pages. Under the circumstances I guess this is the best option.
Thank you very Daniel, you've been very helpful.
-
This is where it goes a bit over my head as a programer, which I'm not, but we would need to dive into the code a bit. I'm not sure I can be of help with details, but from what I'm understanding is as follows.
I understand that if a product is in stock, it shows the page, if the product is not in stock, rather than that pages information changing to say it is no longer in stock, you get redirected to or the page changes to a new page that simply says it can't find what you are looking for.
If I'm right, you need to change the code so when a product is not found or no longer in stock, instead of pointing to this dead page returning zero, or instead of just having that page deleted (in turn being 404), have the page change content or redirect to another page saying it is no longer in stock.
I'm not sure I'm clear here, but what I'm saying is, have it direct to a page you created yourself that says you are temporarily out of stock, rather than the program automatically generating a 404 page.
I hope this helps send you in the right direction, otherwise I'm no programer so can't give you exact instructions, but maybe someone who knows e-commerce programming can help here.
-
Thanks again Daniel.
I'm a web developer too
What would a "proper page" be though? Keep in mind at this point I don't know anything about this product. Each general "out of stock" page will be the same for each product making it a "soft 404" probably, unless I make it a real 404, which will solve the "soft 404" but will create a new problem, 404 pages for some previously valid URLs.
Both are not good, I'm aware of it, however, we are talking less than 0.05% of the site's pages.
-
OK, from what I can see in your example link and what you just confirmed in your last note, the problem is in the design of the database search.
If a product is out of stock, instead of just saying that particular product is out of stock, it comes back with a 0 search results returned. It's basically searching for something and takes you to a page saying that doesn't exist. That would totally explain why you are getting soft 404 errors because you are basically searching for a page that doesn't exist.
You need your web developer to fix this so it takes you to a proper page with some sort of information rather than what is currently a nice looking soft 404 page.
-
Thanks for the reply Daniel. Here's an example link: link
Basically anything with a wrong number will return this page. I know it's not a great page for this purpose, just a regular product page with 0 items and a message. It's just rare enough that we didn't spend too much on it. How rare? According to the Webmaster tool, out of the last 296k pages crawled, 70 were found.
Basically at this point, I have no information on this item, all I know is that someone got here so it's probably a valid product code, which is true unless someone just edited the URL manually.
-
I'm not an expert in this area, but it sounds like a coding issue. Somehow when Google looks at the page it triggers that error. If I understand correctly, when you are out of stock, the system automatically generates a message that says it is out of stock. What does that page look like? Maybe if you post an example of that webpage it could be helpful.
I'm thinking you will need to modify that out of stock template so it includes other information. Whether it be as Kaushal recommended, or even just plain text saying anything. Maybe "Sorry we are currently out of stock, please check back later or contact us for an ETA". Having other information on the page should show to Google it is still an active page with content on it. One way or another, the problem sounds like it's with that out of stock template the database is using.
Maybe I'm way off, but if you link to an example page, that would probably help.
-
Thanks for the reply Kaushal. We actually don't have a system currently that lists similar products and considering we have over 20 million products, it's also not a minor thing to implement. Anyway I'm not sure I like the way other sites try to push products that aren't really what you were looking for.
-
Can't you show message "Product is out of stock for now" message. And show related product below with "You might be interested in below product" message.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Forwarded vanity domains, suddenly resolving to 404 with appended URL's ending in random 5 characters
We have several vanity domains that forward to various pages on our primary domain.
Intermediate & Advanced SEO | | SS.Digital
e.g. www.vanity.com (301)--> www.mydomain.com/sub-page (200) These forwards have been in place for months or even years and have worked fine. As of yesterday, we have seen the following problem. We have made no changes in the forwarding settings. Now, inconsistently, they sometimes resolve and sometimes they do not. When we load the vanity URL with Chrome Dev Tools (Network Pane) open, it shows the following redirect chains, where xxxxx represents a random 5 character string of lower and upper case letters. (e.g. VGuTD) EXAMPLE:
www.vanity.com (302, Found) -->
www.vanity.com/xxxxx (302, Found) -->
www.vanity.com/xxxxx (302, Found) -->
www.vanity.com/xxxxx/xxxxx (302, Found) -->
www.mydomain.com/sub-page/xxxxx (404, Not Found) This is just one example, the amount of redirects, vary wildly. Sometimes there is only 1 redirect, sometimes there are as many as 5. Sometimes the request will ultimately resolve on the correct mydomain.com/sub-page, but usually it does not (as in the example above). We have cross-checked across every browser, device, private/non-private, cookies cleared, on and off of our network etc... This leads us to believe that it is not at the device or host level. Our Registrar is Godaddy. They have not encountered this issue before, and have no idea what this 5 character string is from. I tend to believe them because per our analytics, we have determined that this problem only started yesterday. Our primary question is, has anybody else encountered this problem either in the last couple days, or at any time in the past? We have come up with a solution that works to alleviate the problem, but to implement it across hundreds of vanity domains will take us an inordinate amount of time. Really hoping to fix the cause of the problem instead of just treating the symptom.0 -
404's and Ecommerce - Products no longer for sale
Hi We regularly have products which are no longer sold and discontinued. As we have such a large site, webmaster tools regularly picks up new 404's. These 404 pages aren't linked to from anywhere on the site any longer, however WMT will still report them as errors. Does this affect site authority? Thank you
Intermediate & Advanced SEO | | BeckyKey0 -
404 errors
Hi, we have plenty of 404 errors. We just deal with those that are of the highest priority (the ones that have high page authority). We have also a lot of errors like this: http://www.weddingrings.com/www.yoy-search.com . Does it make sense to redirect those to the home page or leave them as an 404 error?
Intermediate & Advanced SEO | | alexkatalkin0 -
How to properly 404 pages from a subdomain
SO I am working on a site that had a subdomain that attracted a lot of spammy links. I researched the backlinks to this subdomain, and there were no beneficial links at all. I am thinking the best thing is to 404 this subdomain. What is the best way to do this? Should I just edit the DNS settings so that this subdomain does not point to the root domain? Or is there something that should be done in webmaster tools? Thanks in advance!
Intermediate & Advanced SEO | | evan890 -
How to Destroy Old 404 Pages
Hello Mozzers, So I just purchased a new domain and to my surprise it has a domain authority of 13 right out of the box (what luck!). I needed to investigate. To make a long story short the domain used to be home to a music blog that had hundreds of pages which of course are all missing now. I have about 400 pages on my hands that are resulting in a 404. How or what is the best method for eliminating these pages. Does deleting the Crawl Errors in Google Webmaster Tools do anything? Thanks
Intermediate & Advanced SEO | | TheOceanAgency0 -
Can 404 Errors Be Affecting Rankings
I have a client that we recently (3 months ago) designed, developed, and launch a new site at a "new" domain. We set up redirects from the old domain to the new domain and kept an eye on Google Webmaster Tools to make sure the redirects were working properly. Everything was going great, we maintained and improved the rankings for the first 2 months or so. In late January, I started noticing a great deal of 404 errors in Webmaster Tools for URLs from the new site. None of these URLs were actually on the current site so I asked my client if he had previously used to domain. It just so happens that he used the domain a while back and none of the URLs were ever redirected or removed from the index. I've been setting up redirects for all of the 404s appearing in Webmaster tools but we took a pretty decent hit in rankings for February. Could those errors (72 in total) been partially if not completely responsible for the hit in rankings? All other factors have been constant so that lead me to believe these errors were the culprits.
Intermediate & Advanced SEO | | TheOceanAgency0 -
Have you ever seen this 404 error: 'www.mysite.com/Cached' in GWT?
Google webmaster tools just started showing some strange pages under "not found" crawl errors. www.mysite.com/Cached www.mysite.com/item-na... <--- with the three dots, INSTEAD of www.mysite.com/item-name/ I have just 301'd them for now, but is this a sign of a technical issue? The site is php/sql and I'm doing the URL rewrites/301s etc in .htaccess. Thanks! -Dan EDIT: Also, wanted to add, there is no 'linked to' page.
Intermediate & Advanced SEO | | evolvingSEO0 -
Hundreds of thousands of 404's on expired listings - issue.
Hey guys, We have a conundrum, with a large E-Commerce site we operate. Classified listings older than 45 days are throwing up 404's - hundreds of thousands, maybe millions. Note that Webmaster Tools peaks at 100,000. Many of these listings receive links. Classified listings that are less than 45 days show other possible products to buy based on an algorithm. It is not possible for Google to crawl expired listings pages from within our site. They are indexed because they were crawled before they expired, which means that many of them show in search results. -> My thought at this stage, for usability reasons, is to replace the 404's with content - other product suggestions, and add a meta noindex in order to help our crawl equity, and get the pages we really want to be indexed prioritised. -> Another consideration is to 301 from each expired listing to the category heirarchy to pass possible link juice. But we feel that as many of these listings are findable in Google, it is not a great user experience. -> Or, shall we just leave them as 404's? : google sort of says it's ok Very curious on your opinions, and how you would handle this. Cheers, Croozie. P.S I have read other Q & A's regarding this, but given our large volumes and situation, thought it was worth asking as I'm not satisfied that solutions offered would match our needs.
Intermediate & Advanced SEO | | sichristie0