Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Best free tool to check internal broken links
-
Question says it all I guess. What would your recommend as the best free tool to check internal broken links?
-
[Spammy comment removed by forum moderator.]
-
How awesome is that Screaming Frog tool?
-
Hey Kevin,
If you download the CSV report, we should list the referring page in the CSV. I know it'd be better to have it on the on-screen report, and it is on our wish list, but you should be able to see the info in an export.
-
Hi Kevin
Thanks - yes, although I am a Moz Associate, out of full transparency I agree with that you are saying. It is not a tool I specifically use with Moz, and do prefer Screaming Frog for the exact functions you are referring to. Screaming Frog will tell you what pages the bad links are on.
You can definitely pass this on to the product team as a feature request on this page. Personally I love tools like their analytics, keyword difficulty, rank tracker, open site explorer, but I agree from this aspect the crawler is not the strongest, and I would suggest supplementing with Screaming Frog (as I do).
-Dan
-
Dan, although I love me some MOZ the crawl diagnostics kinda suck... all they do is report errors but they don't give any insight on where the bad link is originated... it merely shows the page which is 404ed, which is a BIG FAT WASTE OF TIME.
You guys should know that we need to know WHICH PAGE THE BAD LINK IS ON, and furthermore WHAT LINE OF CODE HAS THE BAD LINK. Who cares about the broken page!?!?!?!?!?
-
Yes when you set up a campaign with Moz Analytics, Moz will crawl your website and return a whole report of suggestions. It will start a sample crawl which gets returned to you pretty quickly, and a full crawl a little bit thereafter. It will report things to you like 400 errors etc.
You can also use the Moz Crawl Test (PRO only as well) which will return to you the HTTP status code of each URL crawled.
Optionally, you can also use Screaming Frog SEO Spider (free up to 500 pages to crawl, paid for bigger sites).
-Dan
-
Does anyone have any clue on how I can check my internal broken links using MOZ tools?
-
Hello,
If you have a full Sitemap, transform it to a .txt by putting only URL (Excel can do that easily) try Screaming Frog SEO on list mode, which is free regardless of the number of links.
Even if you search a free tool, I strongly recommand to invest 99£/year on this tool, it's worth it.
-
Ok, first, does the url with /errors/error_404 (without the query string) exist?
Also - are you using something to create your 404 pages for tracking purposes?
The query string on the url would appear to be stating the referring url anyway - hence ?q=-i3 basically equates to the page /i3
At a guess - it could be there is a script running to create logs on specific 404's, or create a new log each time one occurs - if this folder is visable to the crawlers, it would get spidered and subsequently the problem would arise.
-
Yeah I tried that but the URL in the URL coloumn shows for example:
/errors/error_404?q=-i3
and the Referrer shows:
/-i3
Neither page exists and so I do not know where the page which contains this broken link is...
-
It does, when you get the report, filter column D marked "4XX (Client Error)" and you will see your 404's there - further along in the report you will also be able to see referring url which will show you which page is linking to it.
-
Checked out the tool I just linked to on here and it doesn't include broken link data
-
Is the the custom crawl tool on here you are referring too? http://pro.seomoz.org/tools/crawl-test
-
Custom crawl right here on SEOmoz, or you could use Xenu
-
Hi Dan,
Thanks for that tool. It works great and especially like that it works in Chrome.
Do you however know of a tool which would do this site wide rather than per page?
-
This tool is a great extension for Chrome
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Should we Nofollow Social Links?
I've been asked the question of whether if we should nofollow all of our social links, would this be a wise thing to do? I'm not exactly getting a clear answer from search results and thought you guys would be best to ask 🙂 Thanks in advance.
Technical SEO | Apr 17, 2024, 5:26 PM | JH_OffLimits0 -
How can I stop a tracking link from being indexed while still passing link equity?
I have a marketing campaign landing page and it uses a tracking URL to track clicks. The tracking links look something like this: http://this-is-the-origin-url.com/clkn/http/destination-url.com/ The problem is that Google is indexing these links as pages in the SERPs. Of course when they get indexed and then clicked, they show a 400 error because the /clkn/ link doesn't represent an actual page with content on it. The tracking link is set up to instantly 301 redirect to http://destination-url.com. Right now my dev team has blocked these links from crawlers by adding Disallow: /clkn/ in the robots.txt file, however, this blocks the flow of link equity to the destination page. How can I stop these links from being indexed without blocking the flow of link equity to the destination URL?
Technical SEO | May 12, 2017, 2:12 PM | UnbounceVan0 -
How to set up internal linking with subcategories?
I'm building a new website and am setting up internal link structure with subcategories and hoping to do so with best Seo practices in mind. When linking to a subcategory's main page, would I make the internal link www.xxx.com/fishing/ or www.xxx.com/fishing/index.html or does it matter? I'm just trying to avoid duplicate content I guess, if Google saw each page as a separate page. Any other cautions when using subdirectories in my navigation?
Technical SEO | Nov 13, 2014, 3:12 PM | wplodge0 -
Why are these internal pages not showing any internal links?
If you look at Author profile pages like this one, http://experts.allbusiness.com/author/denise-oberry (THE top contributor on the site with over 82 posts under her belt), or any Author profile page, they show zero internal links or Page Authority. The same goes for most posts for each author on the site. Author pages should show internal links from every post the author has on the site. And specific posts should also have internal links from categories, etc. Yet they show zero. The only posts that show internal links and PA are ones that were either syndicated to the root domain's homepage, or syndicated to Fox Small Business. ZERO internal links. Does anyone know why this is? The root domain does not act this way with Author pages and posts. And I see nothing blocking links or indexing via the robots.txt file or page level nofollow tags. A real head scratcher for this SEO nerd, that I'm sure someone here will have a really simple answer to.
Technical SEO | Sep 24, 2014, 3:41 PM | MiguelSalcido0 -
Should we nofollow footer social links?
Like most sites today we have a whole raft of social links in our footer, these are on every page of the site and link out to Facebook, Twitter, YouTube, etc Should these links be nofollow to avoid juice leaving our site or would you recommend allowing them to be followed to increase the power of these social sites? Is there a definitive Yay or Na on these social links?
Technical SEO | Jul 23, 2014, 11:12 AM | Twist3600 -
404 error - but I can't find any broken links on the referrer pages
Hi, My crawl has diagnosed a client's site with eight 404 errors. In my CSV download of the crawl, I have checked the source code of the 'referrer' pages, but can't find where the link to the 404 error page is. Could there be another reason for getting 404 errors? Thanks for your help. Katharine.
Technical SEO | Nov 17, 2012, 2:22 AM | PooleyK0 -
How to find and fix 404 and broken links?
Hi, My campaign is showing me many 404 problems and other tools are also showing me broken links, but the links they show me dose work and I cant seem to find the broken links or the cause of the 404. Can you help?
Technical SEO | Oct 26, 2012, 4:32 PM | Joseph-Green-SEO0 -
Internal vs external blog and best way to set up
I have a client that has two domians registered - one uses www.keywordaustralia.com the other uses www.keywordaelaide.com He had already bought and used the first domain when he came to me I suggested the second as being worth buying as going for a more local keyword would be more appropriate. Now I have suggested to him that a blog would be a worthy use of the second domain and a way to build links to his site - however I am reading that as all links will be from the same site it wont be worth much in the long run and an internal blog is better as it means updated content on his site. should i use the second domain for blog, or just 301 the second domain to his first domain. Or is it viable to use the second domain as the blog and just set up an rss feed on his page ? Is there a way to have the second domain somehow 'linked' to his first domain with the blog so that google sees them as connected ? NOOBIE o_0
Technical SEO | Oct 4, 2011, 6:42 PM | mamacassi0