Pages that show in Open Site Explorer that show as 404's in search
-
When I use Site Explorer to find our Top Pages there are a whole series of pages like this: http://www.nile-cruises-4u.co.uk/mybestbets/mybestbets-culture.html which I think were created when we had a Bulletin Board on the site.
Although they are showing in the Top Pages results when you visit the page you get the following error message:
HTTP Error 404.0 - Not Found
The resource you are looking for has been removed, had its name changed, or is temporarily unavailable.
What implications result from these pages still showing in results and what action should we take without messing up our search rankings?
Any advice would be gratefully received.
-
If you wish to speed up the process, change the header response to 410 instead of 404 for any pages you know are gone.
-
Thanks very much for such a detailed reply Ryan. I think I'll wait for the link to be removed as you suggest it will be.
Cheers,
Colin
-
404 errors are a natural part of the internet. Pages are added and removed from sites on a regular basis. With that said, when a page is removed from your site, you should take one of two actions:
-
redirect the URL to another very similar page on your site. If you have a page on a Nile 2-day cruise and that page is removed, you may wish to redirect visitors to your Nile 3-day cruise page. This redirection is helpful for users as they find content similar to what they were seeking.
-
allow the page to 404. If you no longer have a similar page, then go ahead and allow the URL to provide a 404 error. This tells search engines the page no longer exists and they will, over time, remove the page from the index.
If you choose the latter approach, be sure you offer a helpful 404 page on your site. Provide your site's normal navigation, a link to a HTML site map, a search box and a most popular articles widget can all be helpful.
The worst thing you can do is allow your server to return an error message not designed for users. Presently, your 404 error page is provided by your server. The error message is unfriendly and not helpful for users.
As an fyi, the URL you shared does not show up in Google.co.uk search results so you have no concerns from that perspective. The link will likely be removed from OSE in 1 or 2 updates.
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate URL errors when URL's are unique
Hi All, I'm running through MOZ analytics site crawl report and it is showing numerous duplicate URL errors, but the URLs appear to be unique. I see that the majority of the URL's are the same, but shouldn't the different brands make them unique to one another? http://www.sierratradingpost.com/clearance~1/clothing~d~5/tech-couture~b~33328/ http://www.sierratradingpost.com/clearance~1/clothing~d~5/zobha~b~3072/ Any ideas as to why these would be shown as duplicate URL errors?
On-Page Optimization | | STP_SEO0 -
Duplicate Content with ?Page ID's in WordPress
Hi there, I'm trying to figure out the best way to solve a duplicate content problem that I have due to Page ID's that WordPress automatically assigns to pages. I know that in order for me to resolve this I have to use canonical urls but the problem for me is I can't figure out the URL structure. Moz is showing me thousands of duplicate content errors that are mostly related to Page IDs For example, this is how a page's url should look like on my site Moz is telling me there are 50 duplicate content errors for this page. The page ID for this page is 82 so the duplicate content errors appear as follows and so on. For 47 more pages. The problem repeats itself with other pages as well. My permalinks are set to "Post Name" so I know that's not an issue. What can I do to resolve this? How can I use canonical URLs to solve this problem. Any help will be greatly appreciated.
On-Page Optimization | | SpaMedica0 -
Why is my contact us page ranking higher than my home page?
Hello, It doesn't matter what keyword I put into Google (when I'm not signed in and have cleaned down my browsing history) the contact us page ranks higher than the home page. I'm not sure why this is, the home page has a higher page authority, more links and more social media shares, the website is an established one. When I have checked Google Analytics my home page gets more people landing on it than the contact us page. It looks like people are ignoring the contact us page and scrolling down until they find the home page. I'd appreciate any help or advice you might have. Thank you.
On-Page Optimization | | mblsolutions2 -
Will Google Custom Search results on my home page kill it's ranking?
This is probably a dumb question, but here goes anyway. 🙂 On a site I have it would be very useful to the reader to offer a search box that uses a Google Custom Search that I have optimized to search websites that are closely on-topic with my site. I know it sounds bad that I would send people to other sites, but just assume that the reasons are valid for this discussion. My question is, if the search results are set to display on the same page (the home page) as the search box, will the links in the search results to external sites just bleed my page rank to death? I assume it would, but thought I'd check just in case I'm missing something. I have to option to place the results on separate page of my site, and noindex it, but it won't be as powerful as it would be on the home page.
On-Page Optimization | | bizzer0 -
Can I add a blog to different pages of my site?
I would like to ad a blog to a few different pages of my site, is this possible? I would prefer it to not be a stand alone blog, because I am pretty sure it would begin to outrank my landing pages in search results. I built my site using dreamweaver, but I have seen a reference somewhere to a utility for adding a word press blog to an existing site? This site seems to be doing what I had in mind? http://www.drynclean.com/
On-Page Optimization | | ayetti0 -
Rethinking company's monthly content production process.
I'm trying to rethink my company's content production process. I believe that we're stuck using a formula that works but can surely be improved. Our Current Process It essentially boils down to posting a certain number of content pieces per month for each client. After the pages are approved and live, there isn't much thought given to them. What We're Thinking After taking a step back, we realize now that a lot of these clients have sites with a tremendous amount of content that is rarely, if ever, revisited. In hopes of creating higher quality content and avoiding having to write that certain number of pieces per month, we're investigating alternative strategies to ensure each client has fresh content. What We're Looking Into Page Edits/Refreshes - I'm beginning to wonder if we can get similar gains by simply refreshing the content that already exists. We can include additional keywords and improve the content in a fraction of the time that it takes to produce a new piece. We're struggling to come up with a process for refreshing the content, however. Ideally we'd be implementing a process where content is revisited 6-12 months, but that still doesn't take care of the problem of creating too much new content. Simplified Version I believe that my company is creating too much content. Editing/refreshing seems like a better use of resources, but I have no idea how to implement a process and develop procedures. Questions What does your content production process look like? Do you produce a certain number a month, a quarter, as needed, etc? How do you go about refreshing your content?
On-Page Optimization | | SeoWebMechanix0 -
Google Page Rank of my site has dropped from 4/10 to 3/10
Google Page rank of my website has been dropped after Panda Update. Can anyone help me out to tell me the possible reasons about the same. We have tried to make our website more lively and user friendly. We have indulged some graphics to make it more attractive. But it seems it backfired us. my site is http://www.myrealdata.com as well as Google page ranking of my Quickbooks hosting page has been dropped as well. It would be great if someone can help me out with expert suggestions.
On-Page Optimization | | SangeetaC1 -
SERP listing of a websites' 'categories'
Hi all, just wondering if anyone has thoughts on what I can do to encourage SERP listings that include website categories, eg http://www.google.com.au/search?q=seomoz&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-a . I'm assuming search engines only display type of listings when the search query closely matches the domain name? Thank heaps!
On-Page Optimization | | TheWebSearchMarketingCompany0