Unsolved URL Crawl Reports providing drastic differences: Is there something wrong?
-
A bit at a loss here. I ran a URL crawl report at the end of January on a website( https://www.welchforbes.com/ ). There were no major critical issues at the time. No updates were made on the website (that I'm aware of), but after running another crawl on March 14, the report was short about 90 pages on the site and suddenly had a ton of 403 errors. I ran a crawl again on March 15 to check if there was perhaps a discrepancy, and the report crawled even fewer pages and had completely different results again.
Is there a reason the results are differing from report to report? Is there something about the reports that I'm not understanding or is there a serious issue within the website that needs to be addressed?
Jan. 28 results:
March 14 results:
March 15 results:
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Added a canonical ref tag and SERPs tanked, should we change it back?
My client's CMS uses an internal linking structure that includes index.php at the end of the URLs. The site also works using SEO-friendly URLs without index.php, so the SEO tool identified a duplicate content issue. Their marketing team thought the pages with index.php would have better link equity and rank higher, so they added a canonical ref tag, making the index.php version of the pages the canonical page. As a result, the site dropped in the rankings by a LOT and has not recovered in the last 3-months. It appears that Google had automatically selected the SEO-friendly URLs as the canonical page, and by switching, it re-indexed the entire site. The question we have is, should they change it back? Or will this cause the site to be reindexed again, resulting in an even lower ranking?
Technical SEO | | TienB240 -
Virtual URL Google not indexing?
Dear all, We have two URLs: The main URL which is crawled both by GSC and where Moz assigns our keywords is: https://andipaeditions.com/banksy/ The second one is called a virtual url by our developpers: https://andipaeditions.com/banksy/signedandunsignedprintsforsale/ This is currently not indexed by Google. We have been linking to the second URL and I am unable to see if this is passing juice/anything on to the main one /banksy/ Is it a canonical? The /banksy/ is the one that is being picked up in serps/by Moz and worry that the two similar URLs are splitting the signal. Should I redirect from the second to the first? Thank you
On-Page Optimization | | TAT1000 -
www3? ...what to do?
I have a site with a ton of errors... things including overlong titles, etc.
On-Page Optimization | | GregDixson
Upon fixing some, they have then re-appeared in the next crawl report as www3. could anyone explain this simply?, and how I should approach the errors.. should I set to ignore the www3. or something else? thanks in advance0 -
How do I set up goals in analytics to track the sales funnel when several pages of the steps required to checkout have the same url?
I have found this in Google Analytic but it makes no sense to me - is there are better resource which explains how you do this step by step ( or a good video perhaps?) Identical URLs Across Multiple Steps In some situations, the URL does not change across a sequence of activity. For example, a sign-up process might have the following URL path: Step 1 (Sign Up): www.example.com/sign_up.cgi Step 2 (Accept Agreement): www.example.com/sign_up.cgi Step 3 (Finish): www.example.com/sign_up.cgi To track visitors' progress through a funnel with the same URL for each step, modify the tracking code to create a virtual URL for each step in the sequence that you want to track. For details on how to use this in your tracking code, see Virtual Pageviews in the _Asynchronous Migration Examples_guide, which shows how to do this in all versions of the tracking code. The following example shows how you might fabricate 3 URLs using the asynchronous tracking code: _gaq.push(['_trackPageview', '/funnel_G1/step1.html']); _gaq.push(['_trackPageview', '/funnel_G1/step2.html']); _gaq.push(['_trackPageview', '/funnel_G1/step3.html']); You would then define your funnel and goal URLs using the ones you created in the tracking code modifications.
Reporting & Analytics | | pookiepro0 -
Google.co.uk & Google.com difference of ranking
How can our website rank on page 3 in google.co.uk and yet it ranks on page 20 for the same keyword on google.com? This doesn't seem to affect our competitors though and its only our site that is being affected/penalized.
Reporting & Analytics | | dobersby0 -
Re-running Crawl Diagnostics
I have made a bunch of changes thanks to the Crawl Diagnostics Tool but now need to re-run as I have lost where I started and what still needs to be done. How do I re-run the crawl diagnostic tool?
Reporting & Analytics | | Professor1 -
WMT tools - setting parameter for redirected URLs
Hi everybody. One of our clients has recently moved from one ecommerce platform to another. During the move, a huge number of URLs have been tidied up to remove dynamic parameters. The old URLs have been redirected to the new, tidy ones. My question is whether it's worth telling Google in the WMT URL parameters section not to index the parameters of the old URLs. Will this affect the redirects in any way? Thanks!
Reporting & Analytics | | neooptic0 -
How Do I Create Custom Reports In GA For First Click Attribution?
It only took me a year and a half to get the code Will Critchlow laid out in a blog post last year put on my website. Now I've finally got it but I need more instruction on how to create the custom report I need in GA! Will said he was going to expand on how to set up the custom reports but I'm not sure he ever did. So, can anyone either direct me to Will's follow-up post about setting up custom reports for first click attribution or tell me how to do it? Thanks!
Reporting & Analytics | | eTundra0