Dead links-urls
-
What is the quickest way to get Google to clean up dead
link? I have 74,000 dead links reported back, i have added a robot txt to
disallow and added on Google list remove from my webmaster tool 4 months ago.
The same dead links also show on the open site explores.Thanks
-
thank you 410 was what i needed.
-
I had 3 inexperience developers, who did not how to write
the urls so they created many different versions. It is hard work out which is
the right version. I also have someone like BT after leavening there service 2
years ago they still seem to index my old links even though my domain is not
with them. They are all for 404 pages. -
I had 3 inexperience developers, who did not how to write
the urls so they created many different versions. It is hard work out which is
the right version. I also have someone like BT after leavening there service 2
years ago they still seem to index my old links even though my domain is not
with them. They are all for 404 pages. -
Can you offer clarification as to what you view as a "dead link"?
If you mean a link to a page on your site which no longer exists, then your options are as follows:
-
take John's advice and 301 the link to the most relevant page on your site
-
allow the link to 404. 404 errors are a natural part of the internet. You should be sure to have the most helpful 404 page possible. Include your site's normal navigation, a search box, most popular articles, etc.
Blocking pages in robots.txt is usually a bad idea and is more likely to add to the problem rather then fix it. If you do not block the page in robots.txt, Google would then crawl the page, see the error and remove it from their index. Because you block the page they can no longer view the page so they will likely leave it in for longer.
Google normally promptly removes web pages submitted with the URL Removal Tool. The tool is designed to remove pages which can damage your site or others. For example, if confidential information was accidentally published. It is not designed to be used to remove 74k pages because you decided to remove them from your website.
If these dead links are simply pages you removed from your site, I advise you to remove the robots.txt block and then decide to 301 them or allow them to 404. Google should then clean up the links within 30-60 days.
If you want to speed up the process as much as possible, there is one other step you can take. Set a 410 (Gone) code for the pages. When Google receives a 404 response, they are unsure if the page is simply temporarily unavailable so they keep it in the index. If they receive a 410 response, you are telling Google the page is GONE and they can update their index faster.
-
-
Are the links 404 pages or just expired content?
-
The links are index, i need them really cleaned up, not a
redirect, and users/customers find it frustrating -
You could try setting up a 301 redirect in htaccess.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Good tool to track external links from the website
I am in search of a tool that provides me links generating from my site to another site. Is there a software or tool that can scan the whole site and provide me what are the links of other sites in my site.
Moz Pro | | csfarnsworth0 -
Why is my internal followed links is 0?
My internal followed links is 0. Also for top pages the report say "block by robots.txt" but the Moz bot is able to crawl my site and generate report for 10K pages. Please help me understand why. http://www.opensiteexplorer.org/comparisons?site=www.findyogi.com
Moz Pro | | namansr0 -
Competitors links increasing rapidly
Hi there, I have 3 main competitors who I keep my eye on within Moz and I am always comparing pages as they are all sell similar products in the same way but we're increasingly getting more things put in place to make ourselves different, which is why we rank number 1 in the UK for their competitive keywords (without blowing my own trumpet!). One thing I have noticed, a competitor seems to be doing things the old school way. He has around 15 competitive keywords in his pages meta tag (irrelevant) and then has a huge 400 - 500 word description on each page describing whats on the page, what products are in that category (if it's a category page) or localised information if it's a company page. What seems to be odd, is that before penguin/panda their website had around 1,200,000 total links. Then after panda, he went down to around 300,000 total links. In the past few weeks I've noticed that he has gradually increased in total links from 300,000(estimate) to now 961,811 total links in a matter of weeks. Is this an error/glitch within Moz or is he doing something that may be classed as "blackhat" or is it something I shouldn't really be worrying about? Any feedback appreciated 🙂 Tom
Moz Pro | | tomhall900 -
OSE vs google webmaster link data
Hiya experts, I am trying to understand the OSE. One thing I noticed is that OSE shows 12 linking root domains to our site. However, google webmasters show more than 90(that have kinks to pages on our site). And these are not new links, some of these date back to Apr 2011. Is there something very obvious I am missing here? Thanks for your help. Regards, Raman.
Moz Pro | | ramangarg0 -
Can I specify a url for a keyword in the rank checker tool?
Hello! I'm new to seomoz and excited to learn the system. I created a campaign and added keywords but I'm not clear how the seomoz campaign rankings tool works. As an example, one of my keywords 'cigar cutters' is reporting at position 20 for url http://www.cheaphumidors.com/c_guillotine-cutters.html. However, I think it would be better target to focus that keyword on http://www.cheaphumidors.com/c_cutters.html. as a search for 'cigar cutters' could encompass either a guillotine cutter, punch cutter or cigar scissors. Is there any way to assign http://www.cheaphumidors.com/c_cutters.html to the term 'cigar cutters' in the campaign ranking report? Brian
Moz Pro | | davesabot0 -
help with the inbound links side of seomoz
Hi Can somebody help with the inbound links tool of seomoz, can you point me in the direction of how it works and the best practices to get the most from it. I know i have a lot more inbound links to the site in my campaign but its shows for example 114 links but when i click on show more it only shows 3 . am i doing something wrong? Any help and advice from how people use it , what for and what is best practice thanks.
Moz Pro | | Bristolweb0 -
How can a competitor show no internal links?
I'm comparing metrics between my site and competitors. Statistics on Site Explorer show that one competitor has no internal links. How is that possible? http://screencast.com/t/P9WX7R9hpdD Thanks for your insight. P9WX7R9hpdD
Moz Pro | | addventures0 -
OpenSiteExplorer is not seeing all my inbound links
I know I have back links to my site from about 5 or 6 websites and most of them even show in my Google webmaster account but according to OSE I only have 1 inbound link. Is it normal for the OSE stats to be wrong? I really want to use it but am worried the info isn't going to be accurate.
Moz Pro | | JasonHegarty0