How to find 20 hidden 404s
-
Hello,
We have like twenty 404s left to find. How do you find these when:
1. They don't show up in Google Webmaster Tools
2. They don't have any other internal or external pages linking to them.
3. They don't show up in site:domain.com (We have 9000 pages and only 600 show up - I fixed those out of the 600).
4. They are probably causing high bounce rates.
5. They're not in the sitemap
Thanks!
-
You should be able to crawl the entire site without increasing the RAM, once you buy the paid version.
-
Right in the paid version wont stop! You can see in their website that the limit of urls will be remove once you buy the license. http://www.screamingfrog.co.uk/seo-spider/licence/
It should catch everything, maybe you can contact their support just to make sure, they are very good on support over twitter.
-
Yes, but if it only check 397 in the free version is it going to stop there in the paid version as well. Just making sure.
Also, will it catch everything?
-
Yes I just run a craw for 500 000 urls
-
The free version checked 397 URLs. Will the purchased version check all 9000?
-
You can try crawl the site using screamingfrog, make sure you check the box “Check Links Outside Folder” in the spider menu.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is hidden content bad for SEO?
I am using this plugin to enable Facebook comments on my blog:
Intermediate & Advanced SEO | | soralsokal
https://wordpress.org/plugins/fatpanda-facebook-comments/ This shows the comment in an Facebook iFrame. The plugin author claims it's SEO friendly, because the comments are also integrated in the WordPress database. The are included in the post but hidden. Is that bad for SEO?0 -
Does having small ticket items (say under $1) available for customers to find & buy help or hurt our site?
I feel really silly asking this question to begin with, but... as a music store, we have a lot of "smalls" for products, like a guitar pick. We sell picks for $0.50 each, or a single clarinet reed at $0.79. Some believe this is too small, finicky, and cumbersome to have listed for sale on our site. To me, I wholeheartedly disagree with the notiion of excluding "smalls" for a plethera of SEO, customer service, & online SALES reasons... Also we offer USPS shipping to offer low shipping costs on small goods. Can I really be wrong about this? Thanks, Kevin
Intermediate & Advanced SEO | | Kevin_McLeish1 -
Have thousands of 404s with backlinks. Should I redirect them all at once or over time?
These error pages are being redirected to the most relevant page, not mass redirected to the home page. Thanks for reading!
Intermediate & Advanced SEO | | DA20130 -
How does the crawl find duplicate pages that don't exist on the site?
It looks like I have a lot of duplicate pages which are essentially the same url with some extra ? parameters added eg: http://www.merlin.org.uk/10-facts-about-malnutrition http://www.merlin.org.uk/10-facts-about-malnutrition?page=1 http://www.merlin.org.uk/10-facts-about-malnutrition?page=2 These extra 2 pages (and there's loads of pages this happens to) are a mystery to me. Not sure why they exist as there's only 1 page. Is this a massive issue? It's built on Drupal so I wonder if it auto generates these pages for some reason? Any help MUCH appreciated. Thanks
Intermediate & Advanced SEO | | Deniz0 -
Magento Hidden Products & Google Not Found Errors
We recently moved our website over to the Magento eCommerce platform. Magento has functionality to make certain items not visible individually so you can, for example, take 6 products and turn it into 1 product where a customer can choose their options. You then hide all the individual products, leaving only that one product visible on the site and reducing duplicate content issues. We did this. It works great and the individual products don't show up in our site map, which is what we'd like. However, Google Webmaster Tools has all of these individual product URLs in its Not Found Crawl Errors. ! For example: White t-shirt URL: /white-t-shirt Red t-shirt URL: /red-t-shirt Blue t-shirt URL: /blue-t-shirt All of those are not visible on the site and the URLs do not appear in our site map. But they are all showing up in Google Webmaster Tools. Configurable t-shirt URL: /t-shirt This product is the only one visible on the site, does appear on the site map, and shows up in Google Webmaster Tools as a valid URL. ! Do you know how it found the individual products if it isn't in the site map and they aren't visible on the website? And how important do you think it is that we fix all of these hundreds of Not Found errors to point to the single visible product on the site? I would think it is fairly important, but don't want to spend a week of man power on it if the returns would be minimal. Thanks so much for any input!
Intermediate & Advanced SEO | | Marketing.SCG0 -
I am SEO amameur and have bee adding links slowly to site. I cannot seem to increase my domain authority from 20 however, Anyone any advice please????
I updated meta tags on website 2/3 months ago and saw a significant improvements in rankings for keyowrds, however since then I have been dropping back down. I am wondering if this is because of low domain authoriyty. it is currentyly 20. www.babskibay.com
Intermediate & Advanced SEO | | babski0 -
Keyword research - how to find additional competitors and links
Hello, We need 100 strong linking root domains to rank at all in our industry (probably more). But all our competitors are using internal pages. I only found one competitor that is using their home page, and I found 12 good backlink possibilities through it. How do I go about finding other competitors? I know this is a general question, but what strategies do you guys use, and could you give examples?
Intermediate & Advanced SEO | | BobGW0 -
How the hell do you find good PR websites?
Hi Guys Can someone please help! How do you find high relevant PR sites that can be easiliy located using the SEO MOZ tools? How can I best use the SEO MOZ tools to locate good websites that will help me with linking building? Are the SEO MOZ tools any good?? Please can you help guys..?? Thanks Gareth
Intermediate & Advanced SEO | | GAZ090