The crawl report shows a lot of 404 errors
-
They are inactive products, and I can't find any active links to these product pages. How can I tell where the crawler found the links?
-
That's too easy Keri.
-
If you download the CSV of the report, there is a column that will list the referring URL for the 404.
-
Mike's suggestion is a great one. SF gives some great data that's easy to play with in Excel. The free version only crawls 500 pages, so if you have a small site, you'll probably get what you need. (I got 30k+ pages, so I use the paid version that's only about $160/yr.)
-
There is nothing wrong with having a "404 error" if the page is an expired product. Obviously, you don't wont to be linking to a 404 page on your site, so I'd suggest using a tool like Screaming Frog, potentially even OSE, and monitoring your 404 pages in Google Webmaster Tools to see if it is still currently being linked to.
If the page has external links pointing to it, I'd recommend 301 redirecting it to whatever category/subcategory the product belongs to.
-
Do a scan with Screaming Frog. It can point out exact pages where you are having broken links.
They have a free trial and a paid version.
This program is great for diagnosing many different website related issues.
Hope this helps.
Mike
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why does a word show as 'Google en-US Mobile Friendly' = FALSE when it also shows that it ranks 3 on mobile?
I pulled a recent report for all words I'm tracking locally and it states that a specific term ranks #4 on desktop and #3 on mobile. But in separate columns, specifically "Google en-US Mobile Friendly" that same terms shows as 'FALSE'. Any idea what this means? Thanks!
Moz Pro | | KristinaWitmer0 -
If links have been disavowed, do they still show in crawl reports?
I have a new client who says they have disavowed all their bad links, but I still see a bunch of spammy backlinks in my external links report. I understand that disavow does not mean links are actually removed so will they continue to show in Google Webmaster Tools and in my Moz reports? If so, how do I know which ones have been disavowed and which have not? Regards, Dino
Moz Pro | | Dino640 -
Raven Reporting Alternative
Does anyone know of a tool that has similar capacity to Raven's Reports? I'm doing some white labeling of reports for another Agency that is used to sending their clients a monthly Raven report that is basicly pulling out all the Google Analytic Data of top referrers, keywords, landing pages ect and putting them into a nice format. I've used the Moz reporting and at times just combined it with a pdf of the actual GA equivalent. That's always seemed a bit clunky but I don't want to have to take on a Raven subscription just for that. Anyone have any good alternatives or know if when the new dashboard launches if it will also up its game when it comes to the generated reports?
Moz Pro | | BCutrer0 -
Crawl Diagnostics - Crawling way more pages than my site has?
Hello all, I'm fairly new here, more of a paid search guy dabbling in SEO on the side. I have a client that I have in SEOMoz and the Crawl Diagnostics report is showing 10,000+ pages crawled and I think the site has at most 800 pages (e-commerce site using freewebstore.org as the platform). Any reasons this would be happening?
Moz Pro | | LodestoneGen0 -
Rank Report Not Updating
The ranking tool indicates that a new rank report will be generated every Tuesday. My last report was on November 15th. It is now November 25th. It missed last week. Should I report something wrong or is this normal? How do I keep it updating on a weekly basis like it's supposed to? I checked in settings to see if I had done anything wrong and couldn't find anything. Regards, Dino
Moz Pro | | Dino640 -
Crawler has stopped crawling my website
Hi all, I recently changed my site www.ipbskinning.com to ipbskinning.com. For some reason my weekly scan states that no pages have been crawled. I tried making a new campaign with the sub-domain ipbskinning.com but still the starter crawl returns nothing? Am I doing something wrong? :S Thanks all!
Moz Pro | | pezza34340 -
Set crawl frequency
Current crawl frequency is weekly, is it possible for me to set this frequency our-self?
Moz Pro | | bhanu22170 -
Recommended Custom Reporting Tool?
Can anyone recommend a reporting system I can use to send reports to my clients based on their campaigns in SEOMOZ This appears to be a missing link in the program - Or as a newbie I just have not found it yet. Thanks in advance!
Moz Pro | | HGbiz0