Identify Page Not Found Visits
-
Hello everyone! I have always known enough about Google Analytics and SEO to be dangerous, but was not a focus for me. I am working on a project were I am looking at stuff where my knowledge is limited.
The scenario is that the domain I am looking at will serve a 404 error, but keeps the url, I guess for tracking purposes.
At the same time, there is a page "Page_Not_Found" that has elevated visits.
-
I am not sure how to tell where the visits are coming from to the PNF since the Previous Page is mostly identified as "(entrance)"
-
Is the PNF correlated to the process of serving an error page but not changing the URL?
Ideally, I am looking to identify and improve the 404 visits. I hope that I provided clear enough information. Happy to provide more as needed.
-
-
@cayk I am not sure how to do that, but I might be able to research and ask around. Thank you.
-
@hankhoffmeier Additional to the other replies here, if you can add an image unique to the 404 error, you could get the information you're hunting for server-side by measuring the hits to the image in question. Many server side reporting tools will also allow showing image downloads by URL, which would workaround your core issue that with regard to the 404 URLS themselves.
-
@lynnpatchett Thank you. I tried ScreamingFrog. Where is did help with some items, it did not help me with the overall problem. I will keep researching.
-
@lynnpatchett said in Identify Page Not Found Visits:
If you think you have internal links to 404 pages try https://www.screamingfrog.co.uk/ - it is a tool to crawl your site and you can filter for your 404s and then see which of your pages the links are on. It is a real timesaver! The free version has some restrictions but should be enough to get you started,
Thank you for the link. That worked for me!
-
@lynnpatchett Thank you. I will take a look at both!
-
@hankhoffmeier Hi, bit of a late reply but try the following:
-
In analytics you can go to the behavior -> site content -> landing page report and the filter for your page not found url (or page title if it is common across 404s). This will give you external sites that are linking to one of your 404 pages.
-
If you think you have internal links to 404 pages try https://www.screamingfrog.co.uk/ - it is a tool to crawl your site and you can filter for your 404s and then see which of your pages the links are on. It is a real timesaver! The free version has some restrictions but should be enough to get you started,
Hope it helps!
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I have over 3000 4xx errors on my site for pages that don't exist! Please help!
Hello! I have a new blog that is only 1 month old and I already have over 3000 4xx errors which I've never had on my previous blogs. I ran a crawl on my site and it's showing as my social media links as being indexed as pages. For example, my blog post link is:
Technical SEO | | thebloggersi
https://www.thebloggersincentive.com/blogging/get-past-a-creative-block-in-blogging/
My site is then creating a link like the below:
https://www.thebloggersincentive.com/blogging/get-past-a-creative-block-in-blogging/twitter.com/aliciajthomps0n
But these are not real pages and I have no idea how they got created. I then paid someone to index the links because I was advised by Moz, but it's still not working. All the errors are the same, it's indexing my Twitter account and my Pinterest. Can someone please help, I'm really at a loss with it.
2f86c9fe-95b4-4df5-aeb4-73570881938c-image.png0 -
Please help us undertsand the things we need to improve so that google crawler visit us more often to reindex pages from our domain
we are currently in the process of a massive project which involves us migrating our domain, we realised that Google crawlwer has not been crawling our pages Quiet often. i have observed some cases where google crawled these pages about 6 months back and then never visited the pages again
Intermediate & Advanced SEO | | bhaskaran
and we had to manually submit these pages for reindexing in some geographies. can you please help us undertsand the things we need to improve so that google crawler visit us more often to reindex pages from our domain0 -
Which of these examples are doorway pages?
Hi there, I am soon to launch a new platform/directory website, however, have a concern over doorway pages. I have read many articles on the difference between Doorway and Landing pages and do have a good understanding, however, am still very anxious that what I intend to do will be risking Google penalties. I have looked at other directory/platform websites and have noticed that a lot of them are still using doorway pages and are not getting penalised. So I was wondering if someone wouldn't mind kindly letting me know their opinion on which of the following examples are doorway pages and which are not so I can better understand what I can and cannot do? Example 1: When I Google 'piano lessons new york' and 'trumpet lessons new york' I get the following 'landing pages' in search: https://takelessons.com/new-york/piano-lessons https://takelessons.com/new-york/trumpet-lessons To me, the above pages are definitely doorway pages as they are very similar with content and text and are simply an intermediary step between the Google search and their listings pages for piano/trumpet teachers in New York. Is this correct? Example 2: When I Google 'piano lessons Sydney' I get presented with the following web page in search: http://www.musicteacher.com.au/directory/sydney-nsw/lessons/piano/ I would think that this is NOT a doorway page as the user has been taken directly to the search results page in the directory and the page doesn't seem to have been set up for the sole purpose of listing in search results for 'Piano Lessons in Sydney'. Example 3: When I Google 'pet minding Sydney' I get presented with the following two pages in search: https://www.madpaws.com.au/petsitters/Sydney-New-South-Wales?type=night&service=1&from=0&to=99&city=Sydney&state=New-South-Wales https://www.pawshake.com.au/petsitters/Sydney%252C%2520New%2520South%2520Wales%252C%2520Australia Like Example 2, I don't think these pages would be classified as doorway pages as they too direct to the search results page in the site directory instead of an intermediary page. What do you think? Thanks so much in advance for your expertise and help! Kind Regards, Adrian
Intermediate & Advanced SEO | | Amor20050 -
Keep Pages with Old Dates?
We have a tourism related site. We list annual events. Right now the URL extension includes the year. I assume it is better to keep the same page and update the dates, thereby keeping any links, ranking trust and authority we built. Is that the best strategy by updating the event info with the new dates? I would assume with a new page for the new year we would be starting over again and would have too much similar content and link diffusion. And in the future are we better off not including the year in the URL extension?
Intermediate & Advanced SEO | | Ebtec0 -
An affiliate website uses datafeeds and around 65.000 products are deleted in the new feeds. What are the best practises to do with the product pages? 404 ALL pages, 301 Redirect to the upper catagory?
Note: All product pages are on INDEX FOLLOW. Right now this is happening with the deleted productpages: 1. When a product is removed from the new datafeed the pages stay online and are showing simliar products for 3 months. The productpages are removed from the categorie pages but not from the sitemap! 2. Pages receiving more than 3 hits after the first 3 months keep on existing and also in the sitemaps. These pages are not shown in the categories. 3. Pages from deleted datafeeds that receive 2 hits or less, are getting a 301 redirect to the upper categorie for again 3 months 4. Afther the last 3 months all 301 redirects are getting a customized 404 page with similar products. Any suggestions of Comments about this structure? 🙂 Issues to think about:
Intermediate & Advanced SEO | | Zanox
- The amount of 404 pages Google is warning about in GWT
- Right now all productpages are indexed
- Use as much value as possible in the right way from all pages
- Usability for the visitor Extra info about the near future: Beceause of the duplicate content issue with datafeeds we are going to put all product pages on NOINDEX, FOLLOW and focus only on category and subcategory pages.0 -
Rel=canonical on image pages
Hi, Im working on a Wordpress hosted blog site. I recently did a "site:search" in Google for a specific article page to make sure it was getting crawled, and it returned three separate URLs in the search results. One was the article page, and the other two were the URLs that hosted the images that are found in the article. Would you suggest adding the rel=canonical tag to the pages that host the images so they point back to the actual context article page? Or are they fine being left alone? Thank you!
Intermediate & Advanced SEO | | dbfrench0 -
Canonical issue with my Home Page
Hi, My site has several canonical issues that should be fixed. http://www.crosscountryallied.com For my Home Page, more links are pointing at www.crosscountryallied.com/ (887) than http:// http://www.crosscountryallied.com/ctAlliedWebSite (27). It is recommended that I implement a 301 redirect to recapture a significant amount of link value. The following lists show the most common canonicalization errors that can be produced when using default settings on my web server: Microsoft Internet Information Services 6 (IIS): http://www.crosscountryallied.com/ http://www.crosscountryallied.com/default.jsp (or .jsp depending on the version) http://crosscountryallied.com/ http://crosscountryallied.com/default.jsp or any combination with different capitalization. Each of these URLs spreads out the value of backlinks to our homepage. Should I just redirect them to: http://www.crosscountryallied.com and add a canonical tag?
Intermediate & Advanced SEO | | Melia0 -
Sitemap not indexing pages
My website has about 5000 pages submitted in the sitemap but only 900 being indexed. When I checked Google Webmaster Tools about a week ago 4500 pages were being indexed. Any suggestions about what happened or how to fix it? Thanks!
Intermediate & Advanced SEO | | theLotter0