Pages that show in Open Site Explorer that show as 404's in search
-
When I use Site Explorer to find our Top Pages there are a whole series of pages like this: http://www.nile-cruises-4u.co.uk/mybestbets/mybestbets-culture.html which I think were created when we had a Bulletin Board on the site.
Although they are showing in the Top Pages results when you visit the page you get the following error message:
HTTP Error 404.0 - Not Found
The resource you are looking for has been removed, had its name changed, or is temporarily unavailable.
What implications result from these pages still showing in results and what action should we take without messing up our search rankings?
Any advice would be gratefully received.
-
If you wish to speed up the process, change the header response to 410 instead of 404 for any pages you know are gone.
-
Thanks very much for such a detailed reply Ryan. I think I'll wait for the link to be removed as you suggest it will be.
Cheers,
Colin
-
404 errors are a natural part of the internet. Pages are added and removed from sites on a regular basis. With that said, when a page is removed from your site, you should take one of two actions:
-
redirect the URL to another very similar page on your site. If you have a page on a Nile 2-day cruise and that page is removed, you may wish to redirect visitors to your Nile 3-day cruise page. This redirection is helpful for users as they find content similar to what they were seeking.
-
allow the page to 404. If you no longer have a similar page, then go ahead and allow the URL to provide a 404 error. This tells search engines the page no longer exists and they will, over time, remove the page from the index.
If you choose the latter approach, be sure you offer a helpful 404 page on your site. Provide your site's normal navigation, a link to a HTML site map, a search box and a most popular articles widget can all be helpful.
The worst thing you can do is allow your server to return an error message not designed for users. Presently, your 404 error page is provided by your server. The error message is unfriendly and not helpful for users.
As an fyi, the URL you shared does not show up in Google.co.uk search results so you have no concerns from that perspective. The link will likely be removed from OSE in 1 or 2 updates.
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Should We Wait To Launch a Redesigned Site After Google's Core Web Vitals & Page Experience Algo Update
We are redesigning our WordPress site (over 1300 posts and pages) and are on schedule to launch in May of 2021. Should we wait for after Google's Core Web Vitals & Page Experience algorithm update?
On-Page Optimization | | opiates0 -
Avoid landing page redirects C (75) SERVER HIGH What's this mean?
HI we have a wordpress website with a chain of redirected urls? one is with www. the other without? How do I found out where this is? or what could be causing it? Any help much appreciated 🙂
On-Page Optimization | | KellyDSD861 -
Should Title Tags Differ From H1's?
I never thought this was an issue, but now, I'm not so sure. Is it a problem for your title tags to be identical to your H1's? From Moz' OnPage Grader section on "H1's and Title Tags," I thought they were supposed to both match your keyword. Any thoughts? Thanks, Ruben
On-Page Optimization | | KempRugeLawGroup0 -
Can soft 404's hurt my rankings?
This post mainly pertains to soft 404's but I recently dropped a few ranks in my main keyword which I have maintained prior to this my better rank for well over 2 years. I participate in NO BLACKHAT and obtain links naturally. I want to describe a few issues that happened prior to my ranking dropping and see what you guys think. I started to receive about a week prior to my ranks dropping DNS issues with GWT. It was weird because when I would use Goole Fetch on those pages they would return just fine so I was not sure what was happening there. I use Google page speed server which did in fact decrease my load time (YEAH!!) so that was cool. About 1 week prior to my rankings dropping I enabled godaddy's Website Accelerator as well thinking that could help even more. Because of this I thought maybe this had something to do with my DNS issues with Google so I decided to turn off my website accelerator with Godaddy and just leave my Google pagespeed service on. I figure I don't need 2 of them anyways IMO. Also at the same time I started to receive a ton (31,000+) html errors with duplicate metadescriptions and titles. I discovered I had an error with my code which was displaying 2 different sets of descriptions and titles for each of these pages. I since then have fixed the issue and waiting for Google to index those pages. Here is were I think I might have been hurting from the drop in rankings. Some months ago (maybe 2) I decided to redirect my 404's to my homepage. Yes I know this is not good now and I have created a proper 404 page which returns the 404 code. I recently started getting a ton of Soft 404 errors in GWT which is what brought my attention to this issue. My question is, could my action of redirecting my users to my homepage as a 404 which obviously was returning a 200 on a page that did not exist be possibly the culprit to my ranks dropping?
On-Page Optimization | | cbielich1 -
Google's Page Layout Algorythm
It seems that Google have been or will penalizing websites with too many ads above the fold. Is it me or Google's search result layout is a perfect example of what NOT to do?
On-Page Optimization | | sbrault741 -
How to design a site map page for users (not for Google)
I would like to design a site map for my visitors so they can have a quick view on the whole content of the website. 2 questions : 1 - is this kind of site map can help in terms of SEO ? 2 - if so, what are the best practices to design it ? Thanks in advance.
On-Page Optimization | | betadvisor0 -
Framed Pages and Dynamic Pages
Has anyone else had experience with different CMS's for Ecommerce . Ones that create static pages and others that dynamically create pages. What differences have you seen with rankings on google with the two. Here are two examples of sites using static framed pages and one with a system that dynamically creates pages - http://www.gardeningexpress.co.uk/ - static frames and http://www.floraselect.co.uk - dynamically
On-Page Optimization | | onlinemediadirect0 -
What's the Best Way to Hide Redirects from Search Engines?
Hey everybody, I like to use php redirects for affiliate links so they look better. I keep them all in the same directory. I read recently that these may hurt SEO. A couple quick questions: Is this the best way to redirect affiliate links? Should I simply block the directory in robots.txt? Any other suggestions from you SEO guyses and galz? Thanks! Jared
On-Page Optimization | | JaredB0