How to find 20 hidden 404s
-
Hello,
We have like twenty 404s left to find. How do you find these when:
1. They don't show up in Google Webmaster Tools
2. They don't have any other internal or external pages linking to them.
3. They don't show up in site:domain.com (We have 9000 pages and only 600 show up - I fixed those out of the 600).
4. They are probably causing high bounce rates.
5. They're not in the sitemap
Thanks!
-
You should be able to crawl the entire site without increasing the RAM, once you buy the paid version.
-
Right in the paid version wont stop! You can see in their website that the limit of urls will be remove once you buy the license. http://www.screamingfrog.co.uk/seo-spider/licence/
It should catch everything, maybe you can contact their support just to make sure, they are very good on support over twitter.
-
Yes, but if it only check 397 in the free version is it going to stop there in the paid version as well. Just making sure.
Also, will it catch everything?
-
Yes I just run a craw for 500 000 urls
-
The free version checked 397 URLs. Will the purchased version check all 9000?
-
You can try crawl the site using screamingfrog, make sure you check the box “Check Links Outside Folder” in the spider menu.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Mystery URLs showing in Analytics - All 404s
Hi Guys So we have a whole load of mystery urls showing in analytics .The urls are completely not relevant and have somehow been created However - when you click on the URLs - they all go to 404 pages - pages not found. The website is a travel website but is showing pages like /overcome-fatigue-during-mesothelioma-treatment/ in analytics. Webmaster is not showing any of these pages - but analytics is showing traffic for them??? My initial thought was that it was a spam URL injection - but they are not pages. They don't exist Our database is fine, WP admin seems fine - none of these supposed pages have been created on WP - so why are they showing on analytics as having driven traffic??? None of the urls are indexed on Google. Its a mystery!!!! Can anyone help? Has anyone seen this before????
Intermediate & Advanced SEO | | CayenneRed890 -
Sudden downfall of the results, intelligents can easily find the solution
Dear, previously my site got top rank results (first place in first page) for 1. "Vastu" (Landing page: https://www.subhavaastu.com/vastu.html) 2. "Vaastu" (Landing page: https://www.subhavaastu.com/vaastu.html) 3. "Vastu shastra" (Landing page: https://www.subhavaastu.com/about-vastu-shastra.html). 4. "Vastu Consultant", (Landing page: https://www.subhavaastu.com) Previously say about 4/5 years back, I got only 1/2 place in google for the above keywords. Now my site is not visible for the said above keywords. But for these below keywords I am getting very good rankings 5. "Vasthu" (Landing page: https://www.subhavaastu.com/vasthu.html) (3 rd position in first page) 6. "Vaasthu" (Landing page: https://www.subhavaastu.com/vaasthu.html) (2nd position in first page) I got good improvements with my attemps. Require to get again first page first rank for these keywords. Vastu, Vaastu, Vastu shastra, vastu consultant. Anybody can help please.
Intermediate & Advanced SEO | | SubhaVaastu0 -
Dealing with 404s during site migration
Hi everyone - What is the best way to deal with 404s on an old site when you're migrating to a new website? Thanks, Luke
Intermediate & Advanced SEO | | McTaggart0 -
How to Find Competitors Traffic Sources
Is it possible to find out where traffic is coming from on someone else website?
Intermediate & Advanced SEO | | Hall.Michael0 -
How to find a skilled SEO sparing partner
We are in need of a skilled SEO sparring partner to work with. We have already done a lot of SEO optimization but the results has not been as good as we hoped. I believe that might be some issues regarding structure or backlinks holding us back from getting results as I can see many competitors with almost no on page optimization or quality backlinks ranking better than us. I want to find someone who can audit our page find the problems. Also set some guidelines on what we should fix and work on to improve the overall rankings fast. Thanks!
Intermediate & Advanced SEO | | nm19770 -
How do you find all of your 301 redirects?
I would like a full list of 301 redirects that we have on our site. Is there a way to export it? I tried Bing Webmaster tools and the list was incomplete. We use IIS. Any ideas?
Intermediate & Advanced SEO | | EcommerceSite0 -
Launching 20 new URLs to branch out from a multi brand website. How do I make sure the rankings stay?
I have a client with a multiple brand website currently. The site has landing pages and directories for each of its 20 brands under one URL. The plan is to build 20 separate brand websites with new domains and have the old content redirect to its corresponding new URL. The problem that I envision is being able to successfully carry all of the existing indexed content over while only using 301 redirects and submitting the new domains to Webmaster tools. Has anyone done this in the past successfully and do you have any recommendations?
Intermediate & Advanced SEO | | Empower_MediaMarketing0 -
Scrolling Text Old School SEO and hidden index page
We have taken over a site and now find our self looking at the homepage of the site which has hidden scrolling text. A old school way of adding text without leaving loads of paragraphs. I have also removed all links to the index.htm page but somewhere visitors are still coming to this page in there droves. I am considering using a canonical url code but I would rather nip it in the bud. Would love some feedback from some other experts here is the site - http://www.radiatorcentre.com You never stop learning in seo and maybe we can all learn from this example. Thanks
Intermediate & Advanced SEO | | onlinemediadirect0