Pages that show in Open Site Explorer that show as 404's in search
-
When I use Site Explorer to find our Top Pages there are a whole series of pages like this: http://www.nile-cruises-4u.co.uk/mybestbets/mybestbets-culture.html which I think were created when we had a Bulletin Board on the site.
Although they are showing in the Top Pages results when you visit the page you get the following error message:
HTTP Error 404.0 - Not Found
The resource you are looking for has been removed, had its name changed, or is temporarily unavailable.
What implications result from these pages still showing in results and what action should we take without messing up our search rankings?
Any advice would be gratefully received.
-
If you wish to speed up the process, change the header response to 410 instead of 404 for any pages you know are gone.
-
Thanks very much for such a detailed reply Ryan. I think I'll wait for the link to be removed as you suggest it will be.
Cheers,
Colin
-
404 errors are a natural part of the internet. Pages are added and removed from sites on a regular basis. With that said, when a page is removed from your site, you should take one of two actions:
-
redirect the URL to another very similar page on your site. If you have a page on a Nile 2-day cruise and that page is removed, you may wish to redirect visitors to your Nile 3-day cruise page. This redirection is helpful for users as they find content similar to what they were seeking.
-
allow the page to 404. If you no longer have a similar page, then go ahead and allow the URL to provide a 404 error. This tells search engines the page no longer exists and they will, over time, remove the page from the index.
If you choose the latter approach, be sure you offer a helpful 404 page on your site. Provide your site's normal navigation, a link to a HTML site map, a search box and a most popular articles widget can all be helpful.
The worst thing you can do is allow your server to return an error message not designed for users. Presently, your 404 error page is provided by your server. The error message is unfriendly and not helpful for users.
As an fyi, the URL you shared does not show up in Google.co.uk search results so you have no concerns from that perspective. The link will likely be removed from OSE in 1 or 2 updates.
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Url shows up in "Inurl' but not when using time parameters
Hey everybody, I have been testing the Inurl: feature of Google to try and gauge how long ago Google indexed our page. SO, this brings my question. If we run inurl:https://mysite.com all of our domains show up. If we run inurl:https://mysite.com/specialpage the domain shows up as being indexed If I use the "&as_qdr=y15" string to the URL, https://mysite.com/specialpage does not show up. Does anybody have any experience with this? Also on the same note when I look at how many pages Google has indexed it is about half of the pages we see on our backend/sitemap. Any thoughts would be appreciated. TY!
On-Page Optimization | | HashtagHustler1 -
Putting review aggregation in product's navigation
Do you guys think it's a bad idea to put a review aggregation page in a product's navigation? Such as: "Which Brand of Men's Shampoo Is Best for You?" Rand suggests against it in this Whiteboard Friday as it interferes with a product's funnel, but I wonder if including it in navigation will give a domain and that page increased authority for a head keyword, such as "men's shampoo." What do you guys think?
On-Page Optimization | | Edward_Sturm0 -
Why Isn't Google Authorship Showing My Picture?
I have several clients and the Google Authorship images used display in the search results for all of them. About a month ago all of the images disappeared, however it still displays "by <name>, indicating that Google Authorship is working -- it just doesn't show the image (see screenshots). The image follows the guidelines, and we've got the rel author tag in place, with a link back to Google. </name> When I use the Google Structured Data Testing Tool it shows that authorship is properly functioning. I'm completely stumped. Does anyone have any ideas why this may not be working? Here's two examples of the sites with Authorship not working properly (screenshots below): criminalattorneylongislandny.com
On-Page Optimization | | socialfirestarter
https://dl.dropboxusercontent.com/u/3786946/Screen Shot 2014-01-03 at 12.53.10 PM.png
https://dl.dropboxusercontent.com/u/3786946/Screen Shot 2014-01-03 at 12.44.12 PM.png attorneytonyadderley.com https://dl.dropboxusercontent.com/u/3786946/Screen Shot 2014-01-03 at 12.52.36 PM.png
https://dl.dropboxusercontent.com/u/3786946/Screen Shot 2014-01-03 at 12.52.52 PM.png0 -
Duplicate Content for Men's and Women's Version of Site
So, we're a service where you can book different hairdressing services from a number of different salons (site being worked on). We're doing both a male and female version of the site on the same domain which users are can select between on the homepage. The differences are largely cosmetic (allowing the designers to be more creative and have a bit of fun and to also have dedicated male grooming landing pages), but I was wondering about duplicate pages. While most of the pages on each version of the site will be unique (i.e. [male service] in [location] vs [female service] in [location] with the female taking precedent when there are duplicates), what should we do about the likes of the "About" page? Pages like this would both be unique in wording but essentially offer the same information and does it make sense to to index two different "About" pages, even if the titles vary? My question is whether, for these duplicate pages, you would set the more popular one as the preferred version canonically, leave them both to be indexed or noindex the lesser version entirely? Hope this makes sense, thanks!
On-Page Optimization | | LeahHutcheon0 -
Duplicate Page Content for Product Pages
Hello, We have one website which URL is http://www.bannerbuzz.com & we have many product pages which having duplicate page content issue in SEOMOZ which are below. http://www.bannerbuzz.com/backlit-banners-1.html
On-Page Optimization | | CommercePundit
http://www.bannerbuzz.com/backlit-banners-10.html
http://www.bannerbuzz.com/backlit-banners-11.html
http://www.bannerbuzz.com/backlit-banners-12.html
http://www.bannerbuzz.com/backlit-banners-13.html We haven't any content on these pages, still getting duplicate page content errors for all pages in SEOMOZ. Please help me how can i fix this issue. Thanks,0 -
Why there's a full-stop in the title of SEOMOZ's home page?
Hello, I see there's a full-stop (.) in the title of SEOMOZ's home page. Why is it so? Regards
On-Page Optimization | | IM_Learner0 -
Does Too Many On-Page Links on a Page Really Matters?
Does Too Many On-Page Links on a Page Really Matters? Especially if they are pointing to internal page?
On-Page Optimization | | AppleCapitalGroup1 -
Another SEO's point of view
Hiya fellow SEO's I have been working on a site - www.hplmotors.co.uk and I must say it has become difficult due to flaws with the content management system . We are speaking with the web site makers to be able to add a unique title, description to all pages. I know what is wrong but I would also like some 2nd opinions on this and welcome any suggestions for the site. A burnt out seo 🙂 thanks
On-Page Optimization | | onlinemediadirect0